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(54) System control method and system control apparatus. 

(57) A control system comprises a plurality of 
peripheral devices represented as objects, and 
a controller connectable to the plurality of 
peripheral devices via a common communi- 
cation line for unitarily controlling the plurality 
of peripheral devices. The controller is arranged 
to be connected to an arbitrary number of 
peripheral devices selected from among the 
plurality of peripheral devices, read control in- 
formation stored in the arbitrary number of 
peripheral devices' via the communication line 
into a predetermined memory area of the con- 
troller in a predetermined format so that the 
controller can control the arbitrary number of 
peripheral devices. The controller is also ar- 
ranged to issue a command and transmit the 
command to each of the arbitrary number of 
peripheral devices via the communication line. 
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The present invention relates to a system control 
method and a system control apparatus both of which 
are suitable for use in system control of multimedia 
devices capable of handling various kinds of informa- 
tion such as texts, sound, still images and moving im- s 
ages. 

In recent years, so-called AV devices which have 
chiefly relied on analog techniques, such as audio 
equipment, video equipment and television sets, 
have been being digitized more and more. As digiti- w 
zation of text information and still image information 
becomes more popular, text information, sound infor- 
mation, still-image information and moving-image in- 
formation are beginning to be unitarily handled within 
computers. 

However, if currently available multimedia devic- 
es (for example, sound input/output devices and im- 
age input/output devices such as digital cameras, 
CD-ROM players, scanners, sound boards and video 
boards) are to be utilized on a computer, it has been 20 
necessary to install application software or device 
drivers dedicated to driving the respective multimedia 
devices on the computer. 

The above-described art has the problem that 
new software or device drivers must be prepared for 25 
new multimedia devices in each computer or OS (Op- 
erating System) and software development becomes 
a heavy burden and efficient and high-rapid control is 
impossible. 

Another problem is that the above-described art 30 
generally does not allow a computer connected to a 
LAN (local area network) to transparently use a mul- 
timedia device connected to a different point of the 
LAN. Accordingly, it has been impossible to realize 
the concept of a multimedia system to enable a plur- 35 
ality of computers to access individual peripheral de- 
vices via a LAN. 

One object of the present invention is to realize a 
highly versatile system environment suitable for con- 
trol of multimedia devices 

Another object of the present invention is to im- 
prove the efficiency of control between multimedia 
devices interconnected via a LAN. 

In accordance with one aspect of the present in- 
vention, there is provided a control system which 45 
comprises a plurality of peripheral devices represent- 
ed as objects and a controller connectable to the plur- 
ality of peripheral devices via a common communica- 
tion line for unitarily controlling the plurality of periph- 
eral devices. The controller is arranged to be connect- so 
ed to an arbitrary number of peripheral devices se- 
lected from among the plurality of peripheral devices, 
read control information stored in the arbitrary num- 
ber of peripheral devices via the communication line 
into a predetermined memory area of the controller in 55 
a predetermined format so that the controller can con- 
trol the arbitrary number of peripheral devices. The 
controller is also arranged to issue a command and 



transmit the command to each of the arbitrary num- 
ber of peripheral devices via the communication line. 

In accordance with another aspect of the present 
invention, there is provided a system control method 
which employs a plurality of peripheral devices repre- 
sented as objects, and a controller for unitarily con- 
trolling the plurality of peripheral devices, and a com- 
mon, bi-directional interface which provides connec- 
tion between the controller and the plurality of periph- 
eral devices and which serves to execute control of 
the plurality of periphery devices or inputting/output- 
ting of data. In the system control method, each of the 
peripheral devices can be controlled by the controller 
via the common, bi-directional interface. 

In accordance with another aspect of the present 
invention, there is provided a system control appara- 
tus which comprises a plurality of peripheral devices 
represented as objects, and a controller for unitarily 
controlling the plurality of peripheral devices via a 
common communication line, the controller and the 
plurality of peripheral devices each including a bi-di- 
rectional interface for bi-directionally communicating 
data over the communication line. Object data about 
control of a function of each of the plurality of periph- 
eral devices is stored in a respective one of the plur- 
ality of peripheral devices in advance. The controller 
loads, when connected to an arbitrary peripheral de- 
vice selected from among the plurality of peripheral 
devices, the object data from the arbitrary peripheral 
device to form an object corresponding to the arbitra- 
ry peripheral device and also to display under control 
of the controller a manipulation picture for manipulat- 
ing the arbitrary peripheral device on the basis of the 
object data. The controller outputs an instruction to 
the communication line via the object in accordance 
with a manipulation based on the manipulation pic- 
ture displayed on the controller, and controls the ar- 
bitrary peripheral device. 

According to the above-described system control 
apparatus, it is possible to transparently use multime- 
dia devices in a common manner through a controller 
via a LAN without the need for special software such 
as application software or a device driver. 

The above and other aspects, features and ad- 
vantages of the present invention will become appa- 
rent from the following detailed description of prefer- 
red embodiments of the present invention, taken in 
conjunction with the accompanying drawings. 

Brief Description of the Drawings: 

Fig. 1 is a view showing a configuration of logical 
connection provided between a multimedia con- 
troller and multimedia devices; 
Figs. 2(a), 2(b) and 2(c) are views showing differ- 
ent configurations of logical connection provided 
between the multimedia controller and the multi- 
media devices; 
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Fig. 3 is a block diagram showing the internal con- 
struction of a multimedia device represented as 
an object; 

Fig. 4 is a block diagram showing the internal con- 
struction of the multimedia controller represent- 5 
ed as an object; 

Fig. 5 is a system hierarchical chart of the multi- 
media controller; 

Fig. 6 is a system hierarchical chart of the multi- 
media device; ^ 10 
Fig. 7 is a view showing a state in which the mul- 
timedia device has not yet been connected to the 
multimedia controller; 

Fig. 8 is a view showing a state in which the mul- 
timedia device is connected to the LAN; 15 
Fig. 9 is a view showing the construction of a gen- 
eral class library; 

Fig. 10 is a view showing the structure of an ob- 
ject; 

Fig. 11 is a view showing the structure of a sys- 20 
tern director object; 

Fig. 12 Is a view showing the construction of a 
control panel description part of a delegate object 
description file; 

Fig. 13 is a view showing the construction of a 25 
data input/output object description part of the 
delegate object description file; 
Fig. 14 is a view showing a state in which a digital 
VTR represented as an object has not yet been 
connected to the multimedia controller; 30 
Fig. 15 is a view showing the structure of a VTR 
controller object; 

Fig. 16 is a flowchart showing the flow of the op- 
eration to be executed when the digital VTR is 
connected to the LAN; 35 
Fig. 1 7 is a diagrammatic view showing a picture 
of the multimedia controller, 
Fig. 1 8 is a view showing a state in which the dig- 
ital VTR which is one multimedia device repre- 
sented as an object is connected to the LAN; 40 
Fig. 19 is a view showing an icon of the digital 
VTR; 

Fig. 20 is a view showing a control panel display 
picture; 

Fig. 21 is a view showing the correspondence be- 45 
tween classes to which individual objects belong 
and the constituent elements of a digital VTR 
control panel object; 

Fig. 22 is an explanatory view showing the gen- 
eration of a play button object; so 
Fig. 23 is a view showing the flowchart of an op- 
eration to be executed when a cursor is placed on 
the icon display of the digital VTR to select a con- 
trol; 

Fig. 24 is a view showing a display picture of the 55 
multimedia controller to be displayed when an 
operator selects a control from among the icon 
displays of the digital VTR; 



Fig. 25 is a view showing the relation between the 
structure of a digital VTR data input delegate ob- 
ject and object description information; 
Fig. 26 is a view showing the relation between the 
structure of a digital VTR data output delegate 
object and object description information; 
Fig. 27 is a view showing the structure of a digital 
VTR data input object; 

Fig. 28 is a view showing the structure of a digital 
VTR data output object; 

Fig. 29 is a view showing the relation between the 
structure of a digital VTR control panel object 
which belongs to a panel class and object de- 
scription information; 

Fig . 30 is a view showing the relation between the 
structure of a panel view setting menu object 
which belongs to a menu class and object de- 
scription information; 

Fig. 31 is an explanatory view showing the func- 
tion of a system director object to select one file 
from a plurality of files when the system director 
object is to read a multimedia device delegate ob- 
ject description file; 

Fig. 32 is a view showing the way of switching the 
control panel; 

Fig. 33 is a view showing a picture which appears 

after the switching of the control panel; 

Figs. 34(a) and 34(b) are views showing different 

examples of the arrangement of manipulating 

buttons; 

Fig. 35 is a view showing the control panel display 
picture of the digital VTR; 

Figs. 36(a) and 36(b) are views showing different 
examples of the control panel displayed on a mul- 
timedia controller display according to a second 
embodiment of the present invention as well as 
the operations of the respective examples; 
Fig. 37 is a view showing the construction of in- 
ternal objects of each of a multimedia controller, 
a digital VTR device and a digital camera device 
as well as the connection status of each of them; 
Fig. 38 is a flowchart showing the processing pro- 
cedure of data input/output managing means; 
Fig. 39 is a flowchart showing a processing pro- 
cedure executed by the data input/output manag- 
ing means to form a link extending from a digital 
camera to a digital VTR; 

Fig. 40 is a view showing the design of a warning 
panel; 

Figs. 41(a) and 41(b) are views respectively 
showing a method part and an internal data part 
of a digital camera output delegate object as well 
as a method part and an internal data part of a 
digital VTR input delegate object; 
Fig. 42 is a view showing a data format of moving- 
image data; 

Fig. 43 is a view showing an internal construction 
of a digital VTR; 
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Fig. 44 is an explanatory view showing the user 
interface of a connection constructer window; 
Fig. 45 is a block diagram showing the construc- 
tion of an internal object of a multimedia control- 
ler according to a third embodiment of the present s 
invention; 

Fig. 46 is a view showing a processing flow of 
connection constructer window display means of 
the connection constructer object; 
Fig. 47 is a view showing the internal structure of w 
the digital camera output delegate object; 
Fig. 48 is a view showing the internal structure of 
a digital camera data output object; 
Fig. 49 is a view showing the internal structure of 
a digital VTR camera controller object; 15 
Figs. 50(a) to 50(e) are views showing the inter- 
nal data parts of the respective objects after a 
link is formed to extend from a digital camera to 
a digital VTR; 

Figs. 51(a) and 51(b) are tables respectively 20 
showing a digital camera acceptability file type 
list and a digital VTR acceptability file type list; 
Fig. 52 is a block diagram showing the construc- 
tion of a fourth embodiment of the present inven- 
tion; ?5 
Fig. 53 is a block diagram showing the construc- 
tion of a digital VTR which is a specific example 
of a multimedia device which will be referred to in 
each of fifth, sixth, seventh, eighth, ninth and 
tenth embodiments; 30 
Fig. 54 is a flowchart of an event loop of a multi- 
media controller according to each of the fifth 
and tenth embodiments; 

Fig. 55 is a conceptual diagram showing a device 
connection management table according to each 35 
of the fifth, seventh, eighth, ninth and tenth em- 
bodiments of the present invention; 
Fig. 56 is a flowchart showing the processing of 
checking the states of connected devices accord- 
ing to the fifth embodiment of the present inven- 40 
tion; 

Figs. 57(a) to 57(d) are conceptual diagrams 
showing means for presenting, to a user of the 
multimedia controller, multimedia devices which 
have had their connections confirmed according 45 
to the fifth embodiment of the present invention; 
Fig. 58 is a flowchart showing the operation of the 
controller for a power on/off manipulation accord- 
ing to the fifth embodiment of the present inven- 
tion ; so 
Fig. 59 is a flowchart showing the operation of a 
multimedia device for the a power on/off manip- 
ulation according to the fifth embodiment of the 
present invention; 

Fig. 60 is a flowchart showing the operation of the 55 
controller when an operation command is gener- 
ated; 

Fig. 61 is a flowchart showing the operation of 

4 



each connected device when the operation com- 
mand is generated; 

Fig. 62 is a flowchart showing the control of an 
event loop of each connected device which con- 
trol is associated with a power on/off operation; 
Fig. 63 is a block diagram showing the construc- 
tion of the sixth embodiment of the present inven- 
tion; 

Fig. 64 is a conceptual diagram showing a state- 
of-connection management table according to 
the sixth embodiment of the present invention; 
Fig. 65 is a flowchart showing an event loop of a 
multimedia controller according to the sixth em- 
bodiment of the present invention; 
Fig. 66 is a flowchart showing an event loop of 
each multimedia device according to the sixth 
embodiment of the present invention; 
Fig. 67 is a block diagram showing the construc- 
tion of the seventh embodiment of the present in- 
vention; 

Fig. 68 is a block diagram showing the construc- 
tion of the eighth embodiment of the present in- 
vention; 

Fig. 69 is a flowchart of processing according to 
each of the seventh and eighth embodiments of 
the present invention as well as each of the ninth 
and tenth embodiments of the present invention; 
Fig. 70 is a flowchart of processing to be execut- 
ed when a connection is confirmed in the flow- 
chart of Fig. 69; 

Fig. 71 is a flowchart of processing to be execut- 
ed when a disconnection is confirmed in the flow- 
chart of Fig. 69; 

Fig. 72 is a conceptual diagram showing the ex- 
ternal appearance of a multimedia device ac- 
cording to the tenth embodiment of the present 
invention; 

Fig. 73 is a flowchart showing an event loop of a 
multimedia controller according to the tenth em- 
bodiment of the present invention; 
Fig. 74 is a block diagram showing the construc- 
tion of the ninth embodiment of the present inven- 
tion; and 

Fig. 75 is a conceptual diagram showing the ex- 
ternal appearance of a cable connector accord- 
ing to the ninth embodiment of the present inven- 
tion. 

Detailed Description of the Preferred Embodiments: 

Embodiments of the present invention will be de- 
scribed below in detail with reference to the accom- 
panying drawings. 

In the present invention, a system control techni- 
que is employed in which individual multimedia devic- 
es are regarded as objects and a controller unitarily 
manages the objects. 

The individual objects, which are managed by the 
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controller, have the functions of sending their own 
functions and control means to the controller. There- 
fore, there is no need to prepare a control program in 
the controller, and it is possible to achieve control only 
by connecting the objects to the controller. 

The controller has means for allowing a person 
who actually specifies control to display or manipu- 
late the control means sent from connected objects, 
so that the controller can manage the multimedia de- 
vices in a centralized manner. Further, it is possible 
to achieve the flexibility and extensibility of being 
able to cope with a new multimedia device without 
making any new preparation. 

Incidentally, the object-oriented concept em- 
ployed in the present invention is described in detail 
in references, such as "Ishizuka: OBJECT-ORIENT- 
ED PROGRAMMING, ASCII, 1988", "Sakai: INTRO- 
DUCTION TO OBJECT-ORIENTED TECHNIQUE, 
OHM sha, 1990" and "B.J. Cocks: OBJECT-ORIENT- 
ED PROGRAMMING, TOPPAN, 1988". Therefore, in 
the following description of each embodiment of the 
present invention, a basic technical description is 
omitted. 

Such an object-oriented technique receives spe- 
cial attention from the viewpoint of more efficient, 
programming development environments, and can 
also be widely utilized in, for example, operating sys- 
tems or multimedia databases. Concepts particularly 
characteristic of the object-oriented technique reside 
in the following three points: 

(1) encapsulation, 

(2) inheritance, and 

(3) messaging. 

The present invention is intended to develop and 
extend the object-oriented technique on the basis of 
the three concepts so that the object-oriented techni- 
que can be adapted to the control of multimedia de- 
vices. 

Fig. 1 shows the configuration of a logical con- 
nection which is provided between a multimedia con- 
troller and multimedia devices on the basis of the ob- 
ject-oriented concept of the present invention. As 
shown, communication paths are formed between a 
plurality of multimedia devices 2 and a multimedia 
controller 1 so that each of the multimedia devices 2 
can directly communicate with the multimedia con- 
troller 1 by passing various kinds of information there- 
between on one-to-one basis via a respective one of 
the communication paths. The multimedia controller 
1 controls each of the multimedia devices 2 by bi-di- 
rectionally communicating messages therebetween 
via the corresponding one of the communication 
paths. The multimedia devices are devices of all kinds 
capable of handling multimedia data, for example, AV 
devices such as CD players, digital video tape recor- 
ders, digital cameras and digital television sets or OA 
devices such as digital facsimiles, digital copying ma- 
chines and printers. 



Although a dedicated device is employed as the 
controller, the controller may also be realized by in- 
stalling a dedicated OS (operating system) and appli- 
cation software on a general-purpose computer such 
5 as a personal computer, a word processor or a work 
station. 

Figs. 2(a) to 2(c) show the physical connection 
configurations required to form a bi-directional com- 
munication path between the multimedia controller 1 

10 and each of the multimedia devices 2. 

Fig. 2(a) shows the daisy chain connection sys- 
tem adopted in SCSI bus systems (ANSI X3.131- 
1986), Fig. 2(b) shows the star connection system 
adopted in Ethernet (IEEE 802.3) 10base-T, and Fig. 

15 2(c) shows the series connection system adopted in 
Ethernet 10Base-2/10base-5. 

Regarding connection configurations, the mixed 
systems shown in Figs. 2(a) to 2(c), such as GPIB 
(IEEE 488), are known, or the mixed systems shown 

20 in Figs. 2(b) and 2(c) are adopted for Ethernet as well. 
Regarding communication systems as well, it is pos- 
sible to select various systems or combinations, such 
as a system employing optical cables and ISDN. 
The following description does not specifically re- 

25 fer to the kinds of techniques for forming such a bidir- 
ectional communication path or which technique is to 
be selected. Physical limitations (such as transfer 
speed, number of connectable devices, length of con- 
nection and shape of connector) due to the differenc- 

30 es between communication systems do not present a 
problem for the bi-directional communication of mes- 
sages because the hierarchies of protocols differ. 
However, to securely form interconnections between 
peripheral devices, it is necessary to use at least one 

35 kind of interface physically (mechanically and/or elec- 
trically) common to all the connected devices. 

To achieve high-speed data communication such 
as moving-image communication, it is possible to 
adopt a technique which employs optical communica- 

40 tion, such as FDDI (Fiber Distributed Data Interface) 
or B-ISDN capable of communicating data at speeds 
higher than Ethernet. By way of example, the follow- 
ing description is made on the assumption that inex- 
pensive and popular Ethernet 10Base-2/10Base-T 

45 connectors are employed as common communication 
connectors. 

Fig. 3 is a block diagram showing the internal 
hardware construction of a general multimedia de- 
vice. 

so A plurality of multimedia devices are connected 

to a multimedia controller by a LAN 4. Since the LAN 
4 is Ethernet, an interface part 20 is provided for proc- 
essing the communications protocol (TCP/IP) of the 
LAN 4. The interface part 20 can be implemented by 

55 using a dedicated LSI or the like. The interface part 
20 takes out a received message itself or sends a 
message to the multimedia controller 1 . For example, 
in the case of Objective-C, a general form of message 
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is expressed as follows: 

[target_object method_name: parame- 
ter] 

In other languages which adopt different forms of ex- 
pressions but are basically similar to Objective-C the 5 
following items are specified: 

(1) target object 

(2) method (process to be executed) 

(3) parameter (if needed) 

The handling of such a message will be described 10 
later with reference to the flow of software shown in 
Fig. 3. 

The multimedia device 2 shown in Fig. 3 includes 
an internal bus 10. a CPU 11 for executing all the soft- 
ware processes and hardware controls, a ROM 12 in 15 
which programs, initial values and unique information 
are stored in advance, a RAM 13 in which to tempor- 
anly store data or internal parameters such as the 
state of the device or which is to be used as a work 
area during execution of a program, a data I/O 14 for 20 
accessing multimedia data 1 5 stored in an internal or 
external medium, a mechanism-part driving part 16 
for controlling a mechanism part 1 7 such as a motor 
and an electrical-part driving part 18 for controlling an 
electrical part 19 such as a switch SW or a display 25 
system including an LED and others. The CPU 1 1 the 
ROM 12, the RAM 13, the data I/O 14, the mecha- 
nism-part driving part 16 and the electrical-part driv- 
ing part 18 are interconnected via the internal bus 10 
The multimedia data 1 5 includes digital data, such as 30 
•mage, sound and texts, which are stored in a partic- 
ular portion which can take various forms, for exam- 
ple, an optical disk such as a CD-ROM or an MD, or 
a magnetic tape medium such as a DCC or a DAX or 
a semiconductor memory card. 3 £ 

Fig. 4 is a block diagram showing the internal 
hardware construction of the multimedia controller 1. 

As shown in Fig. 4, the multimedia controller 1 is 
connected to the multimedia devices 2 by the LAN 4 
Since the LAN 4 is Ethernet, an interface part 31 is 40 
provided for processing the communications protocol 
(TCP/IP) of the LAN 4. The interface part 31 can be 
implemented by using a dedicated LSI or the like The 
interface part 31 takes out a received message itself 
or sends a message to a desired one of the multime- 45 
dia devices 2. 

The multimedia controller 1 shown in Fig 4 in- 
cludes an internal bus 30. a CPU 21 for executing all 
the software processes and hardware controls, a 
ROM 22 in which programs, initial values and unique 50 
information are stored in advance, a RAM 23 in which 
to temporarily store data or internal parameters such 
as the state of the device or which is to be used as a 
work area during execution of a program, a multime- 
dia filing device 25 for executing processes, such as 55 
storage, retrieval, play (reproduction) and editing, of 
multimedia data with respect to either of an internal 
medium and an external medium, a data I/O 24 for 



executing access control of the multimedia filing de- 
vice 25, an electrical-part driving part 28 for control- 
ling an electrical part 29 such as a switch SW or a dis- 
play system including an LED and others, a display 
controller 26 for executing display control of a display 
27 which constitutes a man-machine interface and a 
pointing device (not shown) such as a mouse The 
CPU 21 , the ROM 22, the RAM 23, the multimedia fil- 
ing device 25. the data I/O 24. the electrical-part driv- 
ing part 28, the electrical part 29. the display control- 
ler 26 and the display 27 are interconnected via the 
internal bus 30. 

Fig. 6 is a system hierarchical chart of the soft- 
ware of the multimedia device 2. The internal block di- 
agram shown in Fig. 3 corresponds to hardware 57 
and an OS 58 is provided for executing basic control 
for controlling the hardware 57. Although the kind of 
the OS 58 is not limited to a particular OS, it is desir- 
able to select an OS which has both a real-time proc- 
essing feature and a multitasking function capable of 
simultaneously executing a plurality of programs in 
parallel. To represent the multimedia device 2 as an 
object, a class library 59 unique to the multimedia de- 
vice 2 is provided above the OS 58. 

Although not shown, the system hierarchy also 
includes a library associated with a control panel of 
the multimedia device 2 itself as well as control to be 
executed on the multimedia device 2, which library al- 
lows the multimedia device 2 itself to be controlled by 
the multimedia controller 1 . While the multimedia de- 
vice 2 is connected to the multimedia controller 1 
control unique to the multimedia device 2 can be exe^ 
cuted by the multimedia controller 1 by transmitting 
the library to the multimedia controller 1. At the same 
layer of the system hierarchy, a C function 60 is pro- 
vided for executing a timer operation and an arithmet- 
ic operation. 

The uppermost layer of the system hierarchy is 
occupied by application software 61 which serves to 
execute control of the multimedia device 2 itself and 
communications with the multimedia controller 1 as 
well as providing a user interface. The application 
software 61 can serve to execute various controls of 
the multimedia device 2 itself by exchanging massag- 
es with the multimedia controller 1. and internal para- 
meters can be read out or modified as instance vari- 
ables. 

Fig. 5 is a system hierarchical chart of the soft- 
ware of the multimedia controller 1. The internal block 
diagram shown in Fig. 4 corresponds to hardware 50 
and an OS 51 is provided for executing basic control 
for controlling the hardware 50. Although the kind of 
the OS 51 is not limited to a particular OS. it is desir- 
able to select an OS which has both a real-time proc- 
essing feature and a multitasking function capable of 
simultaneously executing a plurality of programs in 
parallel. 

A window server 52 is provided above the OS 51 
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for executing GUI (Graphical Users Interface) events, 
such as display of a control picture for a plurality of 
connected multimedia devices 2, display of the state 
of the entire system connection, and switching of con- 
trols or switching between data input and data output. 
A common class library 53 stores a group of basic and 
common components (a group of objects) associated 
with a user interface or control, such as button, slide 
volume and text display area, the components being 
prepared in the multimedia controller 1 in advance. 

A unique class library 55 stores a group of com- 
ponents (a group of objects) associated with a panel 
display or control unique to a corresponding one of 
the connected multimedia devices 2. As described 
previously, the number of unique class libraries 55 in- 
creases each time another multimedia device is con- 
nected to the system and sends its unique class libra- 
ry to the multimedia controller 1 . Specific procedures 
for sending such a unique class library will be descri- 
bed later. At the same layer of the system hierarchy, 
a C function 54 is provided for executing a timer op- 
eration and an arithmetic operation. The uppermost 
layer of the system hierarchy is occupied by applica- 
tion software 56 which serves to execute control of 
the entire connected multimedia device 2 and com- 
munications with the multimedia device 2 as well as 
providing a user interface. 

The flow of specific control and the exchange of 
messages between the multimedia controller 1 and 
the multimedia devices 2 will be described below. 

Fig. 7 is a view showing a state in which the mul- 
timedia device 2 has not yet been connected to the 
multimedia controller 1. Referring to Fig. 7, digital 
data is communicated by the LAN 4, and the multime- 
dia controller 1 controls the operation of the entire 
system. The multimedia device 2 to be connected to 
the LAN 4 has a structure generalized as shown in 
Fig. 7. A system director object 205 is a software ob- 
ject (hereinafter referred to as "object") which is res- 
ident in the multimedia controller 1 and performs 
management of the entire system. 

A multimedia device object 1064 is an object 
which functions as a multimedia device which is iden- 
tified as an object by the other objects provided on 
the LAN 4. 

The multimedia device object 1064 includes 
three objects 1065, i066 and 1067. 

The object 1065 is a multimedia device controller 
object for executing control of hardware to realize a 
greater part of the functions of the multimedia device 
2. The object 1066 is a multimedia device data input 
object which serves to receive digital data inputted 
from another device via the LAN 4. The object 1067 
is a multimedia device data output object which 
serves to output digital data to another device via the 
LAN 4. 

Reference numeral 1061 denotes a multimedia 
device delegate object description file which de- 



scribes the specifications of a multimedia device del- 
egate object generated in the multimedia controller 1 
when the multimedia device 2 is connected to the 
multimedia controller 1 via the LAN 4. The multimedia 

5 device delegate object description file 1061 includes 
a multimedia device control panel object description 
part 1062 which describes the specifications of a ma- 
nipulation panel for the multimedia device 2 and a 
data input/output delegate object description part 

10 1 063 which describes the specifications of a data in- 
put/output delegate object which serves as a dele- 
gate to input or output data to or from the multimedia 
device 2. The multimedia device control panel object 
description part 1062 realizes the function of a GUI 

15 description language which describes a control panel 
to be used for manipulating the multimedia device 2 
through a GUI. 

Fig. 8 is a view showing a state in which the mul- 
timedia device 2 is connected to the LAN 4. Referring 

20 to Fig. 8, a multimedia device delegate object 1068 is 
generated in the multimedia controller 1 and func- 
tions as the delegate of the multimedia device 2 in the 
multimedia controller 1. The multimedia device dele- 
gate object 1068 includes a multimedia device control 

25 panel object 1069 which functions as a control panel 
of the multimedia device 2, a multimedia device data 
input delegate object 1 070 which functions as the del- 
egate of the multimedia device data input object 1 066 
during inputting of data, and a multimedia device data 

30 output delegate object 1071 which functions as the 
delegate of the multimedia device data output object 
1067. 

Fig. 9 is a view showing the construction of a gen- 
eral class library. Referring to Fig. 9, a first class 1079 

35 is a class which functions as a template for generating 
objects for defining the nature or function common to 
objects having similar natures. A class library 1086 
includes p classes, i.e., the first class 1079 to a p-th 
class 1085, and each object belongs to a particular 

40 one of the classes. A class definition part 1080 de- 
fines the data types and the names of internal vari- 
ables of objects which belong to the class 1079, as 
; well as the data types and the names of internal func- 
tions (generally called "class method") representative 

45 of data processing means. A class method table 1081 
contains pointers to individual codes of the class 
method in the form of a table to enable access to the 
class method. A code part 1082 stores k function 
codes of the class method which include a first func- 

50 tion code 1083 to a k-th function code 1084. 

Fig. 10 is a view showing the structure of a gen- 
eral object. As shown in Fig. 10, an object 234 in- 
cludes a pointer-to-class-method-table storage part 
244, message communicating means 245, process- 

55 ing retrieving means 246, a method part 239 and an 
internal data part 235. The method part 239 includes 
m data processing means, i.e., first data processing 
means 240, second data processing means 241 
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m-th data processing means 242. An interna! data 
part 235 includes n internal data, i.e., first internal 

data 236, second internal data 237 n-th internal 

data 238. 

Since the individual internal data 236, 237 5 

238 which constitute the internal data part 235* are 
unique to the corresponding object 234, they are con- 
tained in the object 234. However, since the data 
processing means 240, 241, .... 242 which constitute 
the method part 239 can be shared by objects which 10 
belong to the same class, the data processing means 
of from the first data processing means 240 to the m- 
th data processing means 242 are managed for each 
class by the class method table 243 and shared by a 
plurality of objects which belong to the same class. 15 
The class method table 243 is referred to by each of 
the objects by means of the pointers stored in the 
pointer-to-class-method-table storage part 244. 

The message communicating means 245 re- 
ceives a message from another object and sends it to 20 
the processing retrieving means 246. The processing 
retrieving means 246 analyzes the message, re- 
trieves data processing means which corresponds to 
the message from the method part 239 (actually, the 
class method table 243), and causes the retrieved 25 
data processing means to execute data processing. 
The data processing means executes predetermined 
processing of the data added to the'message, internal 
data present in the internal data part 235 and external 
data. In the case of processing which needs to send 30 
a message to another object, the message is sent out 
to the desired object by means of the message com- 
municating means 245. 

Fig. 11 is a view showing the structure of the sys- 
tem director object 205. The system director object 35 
205 shown in Fig. 11 includes a pointer-to-class- 
method-table storage part 1 072 which stores pointers 
to a system director class class method table 1073, 
multimedia device delegate object generating means 
1047 for generating the multimedia device delegate 40 
object 1068 (refer to Fig. 8) on the basis of the de- 
scription of the multimedia device delegate object de- 
scription file 1061, data input/output managing 
means 343 for managing inputting and outputting of 
data between objects, application object generating 45 
means 380 for generating application objects for va- 
rious purposes, message communicating means 
1074, processing retrieving means 342. a method 
part 1075, and an internal data part 1076. The internal 
data part 1076 includes an object ID 1077. device-to- so 
device link information management data 344 to be 
used for causing a plurality of multimedia devices to 
perform a particular operation, and object registration 
information 1078 about connected multimedia devic- 
es and generated objects. 55 

In operation, when the multimedia device 2 is 
connected to the IAN 4, the system director object 
205 reads the multimedia device delegate object de- 



scription file 1061 by using the multimedia device del- 
egate object generating means 1 047, selects a class 
to which an object to be generated belongs, from the 
information described in the multimedia device dele- 
gate object description file 1061, and generates the 
multimedia device delegate object 1068 on the basis 
of the class definition part 1080 of the selected class 
in the class library 1 086. 

Fig. 12 is a view showing the construction of the 
control panel description part of a delegate object de- 
scription file. Referring to Fig. 12, a control panel ob- 
ject description part 247 includes/pieces of object de- 
scription information, i.e., first object description in- 
formation 248 to an Mh object description information 
249. One piece of object description information in- 
cludes object recognition information 250, object 
graphical-display information 254 and object link in- 
formation 260. 

The object recognition information 250 includes a 
class name 251 indicative of a class to which the cor- 
responding object belongs, an object ID 252 which is 
an ID unique to an f-th object, and an object ID 253 
indicative of the ID of an object to which the Ath object 
directly belongs. 

The object graphic information 254 is information 
to be used for graphically displaying objects, such as 
buttons which constitute part of a control panel dis- 
play picture 231, and includes j pieces of object 
graphic information, i.e., first object graphic informa- 
tion 255 to /-th object graphic information 259. One 
piece of object graphic information includes graphi- 
cal-display position and size information 256, shape 
and color information 257 and an object image 258. 

The object link information 260 includes a de- 
scription which provides link information about a link 
between an object, such as a digital VTR controller 
object 207, which constitutes a control panel object 
and an object to which such an object corresponds. 
The object link information 260 includes k pieces of 
object link information, i.e., first object link informa- 
tion 261 to /c-th object link information 264. One piece 
of object link information includes a corresponding 
object ID 262 and a sending message 263 to be sent 
out to a corresponding object. 

Fig. 13 shows the construction of a data in- 
put/output delegate object description part of the del- 
egate object description file. In Fig. 13. a data in- 
put/output delegate object description part 650 in- 
cludes first input delegate object information 651, .... 
m-th input delegate object information 655. Each of 
the input delegate object information 651 to 655 in- 
cludes an object ID 652 of its own, a link-target cor- 
responding data input object ID 653 indicative of the 
ID of a data input object to be linked, and an accept- 
able file type list 654 which is a list of file types which 
can be inputted. The data input/output delegate ob- 
ject description part 650 also includes first output del- 
egate information 659 n-th output delegate object 
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information 663. Each of the output delegate object 
information 659 to 663 includes an object ID 660 of its 
own, a corresponding data output object ID 661 indi- 
cative of the ID of a corresponding data output object, 
and an acceptable file type list 662 which is a list of 
file types which can be outputted. 

The operation of the above-described embodi- 
ment will be described below with reference to a dig- 
ital VTR which is one specific example of the multi- 
media devices 2 based on the above-described sys- 
tem control system. 

Fig. 14 is a view showing a state in which a digital 
VTR represented as an object has not yet been con- 
nected to the multimedia controller 1. As shown in Fig. 
14, reference numeral 203 denotes the digital VTR, 
and a digital VTR object 206 is resident in the digital 
VTR 203 and functions as a digital VTR which is iden- 
tified as an object by the other multimedia devices 
provided on the LAN 4. The digital VTR object 206 in- 
cludes three objects. A digital VTR controller object 
207 executes hardware control of the digital VTR 203. 

A digital VTR data input object 208 serves to re- 
ceive digital data inputted from another multimedia 
device via the LAN 4. A digital VTR data output object 

209 serves to output digital data to another multime- 
dia device via the LAN 4. A digital VTR delegate object 
description file 210 describes the specifications of a 
digital VTR delegate object generated in the multime- 
dia controller 1 when the digital VTR 203 is connected 
to the multimedia controller 1 via the LAN 4. 

The digital VTR delegate object description file 

210 includes a digital VTR control panel object de- 
scription part 211 which describes the specifications 
of a manipulation panel for the digital VTR 203 and a 
digital VTR data input/output delegate object descrip- 
tion part 212 which describes the specifications of a 
digital VTR data input/output delegate object which 
serves as a delegate to input or output data to or from 
the digital VTR 203. 

Fig. 15 is a view showing the structure of the dig- 
ital VTR controller object 207. Referring to Fig. 15, a 
pointer-to-class-method-table storage part 1009 
stores pointers to a class method table 1018. The 
class method table 1018 includes a multiplicity of data 
processing means such as play executing means 
1019 for controlling the hardware of the digital VTR 
203 executing and executing a playback operation 
and recording executing means 1020 for executing a 
recording operation. The digital VTR controller object 
207 also includes message communicating means 
1010, processing retrieving means 1011, a method 
part 1012 and an internal data part 1015. A control 
class class method table 1018 contains actual data 
processing means to be executed by the method part 
1012. The internal data part 1015 includes a multipli- 
city of variables and status information, such as a 
tape running state 1016 and a current tape position 
1017, which are needed to control the digital VTR 



203. 

First of all, an operation to be executed when the 
digital VTR 203 is connected to the LAN 4 will be de- 
scribed below. Fig. 1 6 is a flowchart showing the flow 
5 of the operation to be executed when the digital VTR 
203 is connected to the LAN 4. Fig. 17 is a diagram- 
matic view showing a picture of the multimedia con- 
troller 1. In Fig. 17, reference numeral 228 denotes a 
display picture of the multimedia controller 1, refer- 
to ence numeral 229 denotes an icon display indicating 
that the digital VTR 203 is connected, and reference 
numeral 230 denotes a cursor indicating a position in- 
dicated by a pointing device such as a mouse. Al- 
though not shown, the pointing device has a button, 
15 and the operation of pressing and releasing the but- 
ton is generally called "click" and the operation of re- 
peating the click twice at a predetermined interval is 
generally called "double-click". Incidentally, a camera 
(still image input device), a tuner, a television set, va- 
20 rious databases, a CD and other multimedia devices 
are connectable to the multimedia controller 1, and 
selection and control of such multimedia devices can 
be performed through icon displays on the display 
picture 228. 

25 Fig. 1 8 is a view showing a state in which the dig- 

ital VTR 203, which is one example of the multimedia 
devices 2, is connected to the LAN 4. Referring to Fig. 
18, a digital VTR delegate object 220 is generated in 
the multimedia controller 1 when the digital VTR 203 

30 is connected to the LAN 4, and functions as the del- 
egate of the digital VTR 203 in the multimedia control- 
ler 1. The digital VTR delegate object 220 includes a 
digital VTR control panel object 221 which functions 
as a control panel of the digital VTR 203, a digital VTR 

35 data input delegate object 222 which functions as the 
delegate of the digital VTR data input object 208 dur- 
ing inputting of data, and a digital VTR data output 
delegate object 223 which functions as the delegate 
of the digital VTR data output object 209. 

40 An operation to be executed when the digital VTR 

203, which is one example of the multimedia devices 
2, is connected to the LAN 4 will be described below 
with reference to Figs. 16, 17 and 18. When the digital 
VTR 203 represented as an object is connected to the 

45 LAN 4 (Step 636), the system director object 205 rec- 
ognizes the connection to the digital VTR 203 (Step 
637). Then, the system director object 205 sends a 
device ID to the digital VTR 203 (Step 638). 

Then, the system director object 205 loads the 

so digital VTR delegate object description file 21 0 from 
the digital VTR 203 by using the multimedia device 
delegate object generating means 1047 (Step 639). 
Then, the system director object 205 generates the 
digital VTR delegate object 220 in the multimedia 

55 controller 1 on the basis of the digital VTR delegate 
object description file 210 by using the multimedia 
device delegate object generating means 1047 (Step 
640). The resultant state of connection is shown in 

9 
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Fig. 18. Then, the digital VTR delegate object 220 dis- 
plays the icon display 229 of the digital VTR 203 on 
the display picture 228 of the multimedia controller 1 
(Step 641). Subsequently, the digital VTR delegate 
object 220 waits for an instruction to be inputted by 5 
a user (Step 642). 

Subsequently, the user can the digital VTR 203 
via the digital VTR delegate object 220 provided in the 
multimedia controller 1 by manipulating the digital 
VTR 203 on the basis of the manipulation picture dis- 10 
played on the basis of the digital VTR control panel 
object 221 of the multimedia controller 1. 

The relationship between the description of the 
digital VTR delegate object description file 210 and 
generated objects will be described below in further 15 
detail. 

Fig. 19 is a view showing the icon display of the 
digital VTR 203, and Fig. 20 is a view showing one ex- 
ample of a control panel display picture. Fig 19 
shows the icon display 229 to be displayed when the 20 
digital VTR 203 is connected to the LAN 4. Fig. 20 
shows a default display picture graphically displayed 
by the digital VTR control panel object 221. The de- 
fault display picture includes a control panel display 
selecting menu 232 displayed on the display picture 25 
a time counter display 265 for indicating the elapsed 
time of tape, a control mode selecting part 266 for se- 
lecting a control mode of the digital VTR 203, a first 
switch button display 267 for selecting a default con- 
trol mode, a second switch button display 268 for se- 30 
lecting a detailed control mode, a rewinding button 
display 269, a reverse play button display 270, a 
pause button display 271 , a play button display 272, 
a fast forward feed button display 273, a stop button 
display 274 and a recording button display 275. 35 

Fig. 21 is a view showing the correspondence be- 
tween the classes to which individual objects belong 
and the constituent elements of the digital VTR con- 
trol panel object 221. The classes to which the re- 
spective basic constituent elements belong are de- 40 
fined in the class library 1081 (refer to Fig. 9) in ad- 
vance, and are held in the multimedia controller 1 As 
shown in Fig. 21, the individual constituent elements 
of the digital VTR control panel object 221 functions 
as objects which constitute the digital VTR control 45 
panel object 221. 

As shown in Fig. 21, the frame of the control pan- 
el display picture 231 corresponds to a VTR control 
panel object 284 (ID = 1) which belongs to a panel 
class. The control panel display selecting menu 232 50 
corresponds to a panel view setting menu object 285 
(ID - 2) which belongs to a menu class. The time 
counter display 265 corresponds to a time counter ob- 
ject 286 (ID = 3) which belongs to a form class. The 
rewinding button display 269 corresponds to a re- 55 
winding button object 287 (ID = 4) which belongs to a 
button class. The reverse play button display 270 cor- 
responds to a reverse play button object 288 (ID = 5) 



which belongs to the button class. The pause button 
display 271 corresponds to a pause button object 289 
(ID - 6) which belongs to the button class. The play 
button display 272 corresponds to a play button ob- 
ject 290 (ID = 7) which belongs to the button class 
The fast forward feed button display 273 corresponds 
to a fast forward feed button object 291 (ID = 8) which 
belongs to the button class. The stop button display 
274 corresponds to a stop button object 292 (ID = 9) 
which belongs to the button class. The recording but- 
ton display 275 corresponds to a recording button ob- 
ject 293 (ID = 10) which belongs to the button class. 

The control mode selecting part 266 corresponds 
to a control mode switching object 294 (ID =11) which 
belongs to a button group class. The first switch but- 
ton display 267 corresponds to a default button object 
295 (ID = 12) which belongs to a radio button class. 
The second switch button display 268 corresponds to 
an advanced button object 296 (ID = 13) which be- 
longs to the radio button class. 

The generation of the play button object 290 
which is one of the objects constituting the digital 
VTR control panel object 221 will be described below 
by way of example. 

Fig. 22 is an explanatory view showing the gen- 
eration of the play button object 290. In Fig. 22, ref- 
erence numerals 297, 298, 299, 300, 601, 602 603 
604, 605, 606, 607, 608, 609, 610 and 611 denote the 
elements described in the control panel object de- 
scription part 247 of the digital VTR delegate object 
description file 210. 

The object recognition information 297 includes 
the class name 298, the object ID 299 and the object 
ID 300 of an object to which the play button object 290 
belongs. The first object graphical-display informa- 
tion 601 includes the graphical-display position and 
size information 602, the shape and color information 
603 and the object image 604. The second object 
graphical-display information 605 includes the graph- 
ical-display position and size information 606, the 
shape and color information 607 and the object image 
608. The object link information 609 includes the link 
target object ID 610 and the sending message 611. 

The play button object 290 is generated from the 
button class and the information described in the con- 
trol panel object description part 247 of the digital 
VTR delegate object description file 21 0. A pointer-to- 
class-method-table storage part 613 stores pointers 
which point to a button class class method table 625. 
The button class class method table 625 includes but- 
ton initializing means 626 for initializing the internal 
variables of a button object when an object of the but- 
ton class is to be generated, button graphic displaying 
means 627 for graphically displaying the play button 
object 290, and click responsemeans 628. If the user 
specifies a desired position at which the play button 
object 290 is to be graphically displayed, by means of 
the cursor 230 of the pointing device such as a mouse 



10 



BNSDOCIO: <EP„ .-^7157A2 I 



19 EP 0 637 1 57 A2 20 



and executes a click operation, the click response 
means 628 responds to the click operation to indi- 
cates that the play button object 290 has been 
clicked, as by temporarily changing the state of a but- 
ton display, and sends a message to another object. 

The definitions of these respective data process- 
ing means which are held on the button class class 
method table 625 are described in a class, and are re- 
ferred to and used in common by not only the play but- 
ton object 290 but also all the objects which belong to 
the other button classes. The play button object 290 
includes message communicating means 614 and 
processing retrieving means 615. The play button ob- 
ject 290 also includes a method part 616 and an in- 
ternal data part 620. The internal data part 620 in- 
cludes an object ID 621, button state data 622, a 
graphical-display parameter 623 and link data 624. 
The types of internal data to be possessed by not only 
the play button object 290 but also all the button ob- 
jects which belong to the button class are described 
in a class. 

The system director object 205 reads the digital 
VTR delegate object description file 210 to generate 
the individual objects. In the example shown in Fig. 
22, the system director object 205 generates the ob- 
jects of the button class on the basis of the descrip- 
tion of the class name 298 of the object recognition in- 
formation 297. If the system director object 205 is to 
generate the digital VTR data output object 209, the 
internal data part 620 is initialized by the button ini- 
tializing means 626. In the example shown in Fig. 22, 
the object ID 621 is set to ID = 7 in accordance with 
the description of the object ID 299. From the descrip- 
tion of the object ID 300 of an object to which the ob- 
ject (ID = 7) belongs, the system director object 205 
understands that the play button object 290 belongs 
to the digital VTR control panel object 221 . Thus, from 
object ID information about objects to which the re- 
spective objects belong, the system director object 
205 understands an object-to-object relationship rep- 
resenting which object belongs to which object, and 
generates an object made up of a plurality of objects 
in the form of a composite object. 

The button graphic displaying means 627 graph- 
ically displays the play button object 290 on the basis 
of the graphical-display parameter 623 and the button 
state data 622. The button graphic displaying means 
627 is automatically executed when a button object is 
to be generated and when an object to which an object 
belongs is moved. 

The first object graphical -display information 601 
describes graphical-display information 629 indica- 
tive of the play button which is not pressed. The 
graphical-display position and size information 602 
describes rectangular-frame information indicative of 
the graphical-display position and the size of the play 
button object 290 in the digital VTR control panel ob- 
ject 221. The rectangular-frame information is de- 



fined by coordinate information relative to the coor- 
dinate system of the digital VTR control panel object 
221, and is represented by, for example, the coordin- 
ates of a top-left point and those of a right-bottom 

5 point such as (X1, Y1) and (X2, Y2) of the graphical- 
display information 629 indicative of the play button 
which is not pressed. Graphical display of the play 
button which is not pressed is provided on the basis 
of either the shape and color information 603 or the 

10 object image 604. The shape and color information 

603 is described in a language which serves to graph- 
ically display an object, such as the way of drawing 
lines and the way of painting colors. The object image 

604 is represented as bit-map data. In general, the 
15 shape and color information 603 using such a lan- 
guage does not need a large amount of data, but the 
object image 604 using the bit-map data provides 
great flexibility. 

The second object graphical-display information 

20 605 describes graphical-display information 630 indi- 
cative of the play button which is pressed, in a manner 
similar to the first object graphical-display informa- 
tion 601. A graphical-display parameter 623 is deter- 
mined on the basis of the f irst object graphical-display 

25 information 601 and the second object graphical-dis- 
play information 605. The link data 624 is set on the 
basis of the object link information 609, and "PLAY" 
is set as a sending message and a link target object 
ID is set as the link target object ID 610. In order to 

30 uniquely determine a receiver object in the entire sys- 
tem before the message is sent out, the device ID, 
which is assigned to the digital VTR 203 by the system 
director object 205 when the digital VTR 203 is con- 
nected to the LAN 4, is added to the link target object 

35 ID 610. 

Accordingly, if identical IDs are assigned to dif- 
ferent objects of different devices, it is possible to 
transmit the message to a desired object. The button 
state data 622 holds state data indicating whether the 

40 play button is pressed. 

Fig. 23 is a view showing the flowchart of an op- 
eration to be executed when a user places the cursor 
230 on the icon display 229 of the digital VTR 203 and 
double-clicks the icon d isplay 229, as well as the f low- 

45 chart of an operation to be executed when the user 
manipulates the control panel of the digital VTR 203. 

Fig. 24 is a view showing a display picture of the 
multimedia controller 1 to be displayed when the user 
double-clicks the icon display 229 of the digital VTR 

so 203. In the display picture shown in Fig. 24, the con- 
trol panel display picture 231 of the digital VTR 203 
is displayed as a default control display picture, and 
the play button display 272 is displayed as shown. 
Fig. 29 is a view showing the structure of the dig- 

55 ital VTR control panel object which belongs to the 
panel class as well as the relationship between the 
structure and object description information. 

In Fig. 29, the digital VTR control panel object 221 
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includes a pointer-to-class-method-table storage part 
1401 which stores pointers to a panel class class 
method table 1402. The panel class class method ta- 
ble 1402 includes panel initializing means 1403 for ini- 
tializing a panel object, panel graphic displaying s 
means 1404 for graphically displaying a panel, and 
click response means 1405 for displaying a click re- 
sponse operation when the panel is double-clicked. 
The digital VTR control panel object 221 also includes 

message communicating means 1406 t processing re- 10 
trieving means 1407 and internal data part 1410. The 
internal data part 1410 includes an object ID 1411, 
panel state data 1412 and a graphical-display para- 
meter 1413. The internal data part 1410 is initialized 
in accordance with the description of the digital VTR 15 
delegate object description file 210. The digital VTR 
control panel object description part 211 of the digital 
VTR delegate object description file 210 includes ob- 
ject recognition information 1414, first object graphic 
information 1418 indicative of an icon image 1426 of 20 
the digital VTR 203, and second object graphic infor- 
mation 1422 indicative of a frame 1427 of the control 
panel of the digital VTR 203. The object recognition 
information 1414 includes a class name (panel class) 
1415, an object ID (ID = 1) 1416 and an object ID 1417 25 
of an object to which the object belongs. The first ob- 
ject graphic information 1418 includes graphical-dis- 
play position and size information 1419, the shape 
and color information 1420, and an object image 
1421. The second object graphic information 1422 in- 30 
eludes graphical-display position and size informa- 
tion 1423, shape and color information 1424, and an 
object image 1425. 

The operation of displaying the control panel of 
the digital VTR 203 and a technique for instructing a 35 
playback operation to be executed will be described 
below with reference to Figs. 23 and 29. 

In the operation described with reference to Fig. 
16, at the time when the system director object 205 
generates the digital VTR delegate object 220, the 40 
digital VTR delegate object 220 displays the icon dis- 
play 229 on the basis of the icon image 1426. If the 
user double-clicks the icon display 229 of the digital 
VTR 203 while placing the cursor 230 on the icon dis- 
play 229 (Step 643), the digital VTR control panel ob- 45 
ject 221 of the digital VTR delegate object 220 sends 
messages to all the objects which constitute the dig- 
ital VTR control panel object 221, thereby instructing 
all the objects to execute the respective graphical dis- 
plays. All the objects shown in Fig. 21 execute their so 
graphical display means in accordance with the re- 
spective messages, and the digital VTR control panel 
object 221 graphically displays the frame of the con- 
trol panel of the digital VTR 203 on the basis of the 
second object graphic information 1422. Thus, the 55 
digital VTR control panel display picture 231 for ma- 
nipulating the digital VTR 203 is displayed as shown 
in Fig. 24 (Step 644), and the flow waits for an instruc- 



tion to be given by the user (Step 645). During this 
state, if the user clicks the play button display 272 of 
the control panel display picture 231 while placing the 
cursor 230 on the play button display 272 (Step 646) 
the digital VTR control panel object 221 sends the 
massage "PLAY" to a controller object 214 of the dig- 
ital VTR 203 (Step 647). Thus, the controller object 
214 of the digital VTR 203 activates play executing 
means in response to the message (Step 648). When 
the play executing means is activated, the play oper- 
ation of the digital VTR 203 is started (Step 649). 

As described above, in accordance with the 
above-described embodiment, only by connecting a 
multimedia device to a multimedia controller via a 
LAN, the multimedia device delegate object required 
to manipulate the multimedia device is automatically 
generated in the multimedia controller. Further, the 
control panel required to manipulate the multimedia 
device is automatically displayed on the display pic- 
ture of the multimedia controller, and if a user manip- 
ulates the control panel, an appropriate message is 
sent to a controller object of the multimedia device so 
that a desired manipulation can be performed. The in- 
formation required to generate the multimedia device 
delegate object required to manipulate the multime- 
dia device is obtained from a multimedia device del- 
egate object description file read from the multimedia 
device. Accordingly, the multimedia controller needs 
only to have a basic class library, and does not need 
to have information about a specific multimedia de- 



vice. 
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Fig. 25 is a view showing the structure of the dig- 
ital VTR data input delegate object as well as the re- 
lationship between the structure and object descrip- 
tion information. The digital VTR data input delegate 
object 222 shown in Fig. 25 includes a pointer-to- 
class-method-table storage part 668 which store 
pointers to a data input delegate class class method 
table 679. The data input delegate class class method 
table 679 includes data input delegate object initializ- 
ing means 680, link information updating means 681 
and acceptable file type replying means 678. 

The digital VTR data input delegate object 222 
also includes message communicating means 669, 
processing retrieving means 670 and a method part 
671. An internal data part 674 includes an object ID 
675, corresponding data input object ID 676 indicative 
of the ID of a corresponding data input object, an ac- 
ceptable file type 677 indicative of the file types of 
data which can be inputted, link information 1006 in- 
dicative of a link to a data output object. 

The digital VTR data input delegate object 222 is 
generated on the basis of the digital VTR data in- 
put/output delegate object description part 21 2 of the 
digital VTR delegate object description file 21 0. Input 
delegate object information 682 which is described in 
the digital VTR data input/output delegate object de- 
scription part212 includes an object ID (in this exam- 
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pie, ID = 1) 683, a corresponding data input object ID 
(in this example, ID = 1) 684, and an acceptable file 
type list 685 (which conforms to formats called AV1 
and AV2, in this example). The data input delegate ob- 
ject initializing means 680 initializes the data of the in- 
ternal data part 674 in accordance with the descrip- 
tions of the input delegate object information 682. 

Fig. 26 is a view showing the structure of the dig- 
ital VTR data output delegate object as well as the re- 
lationship between the structure and object descrip- 
tion information. The digital VTR data output delegate 
object 223 shown in Fig. 26 includes a pointer-to- 
class-method-table storage part 690 which stores 
pointers to a data output delegate class class method 
table 1048. The data output delegate class class 
method table 1048 includes data input delegate ob- 
ject initializing means 694, data input instruction 
sending means 695 and acceptable file type replying 
means 700. 

The digital VTR data output delegate object 223 
also includes message communicating means 691, 
processing retrieving means 692, a method part 693 
and an internal data part 696. The internal data part 
696 includes an object ID 697, a corresponding data 
output object ID 698 which is the ID of a correspond- 
ing data output object ID, an acceptable file type 699 
indicative of the file types of data which can be input- 
ted, and link information 688 indicative of a link to an 
data output object 

The digital VTR data output delegate object 223 
is generated on the basis of the digital VTR data in- 
put/output delegate object description part212 of the 
digital VTR delegate object description file 210. Out- 
put delegate object information 1001 which is descri- 
bed in the digital VTR data input/output delegate ob- 
ject description part 212 includes an object ID (in this 
example, ID = 1) 1002, a corresponding data output 
object ID (in this example, ID = 1) 1 003 and an accept- 
able file type list 1 004 (which conforms to the formats 
called AV1 and AV2, in this example). The data output 
delegate object initializing means 694 initializes the 
data of the internal data part 696 in accordance with 
the description of the output delegate object informa- 
tion 1001. 

Fig. 27 is a view showing the structure of the dig- 
ital VTR data input object. The digital VTR data input 
object 208 shown in Fig. 27 includes a pointer-to- 
class-method-table storage part 1022 which stores 
pointers to a data input class class method table 
1031. The data input class class method table 1031 
includes file writing means 1032, data receiving 
means 1033 and link information updating means 
686. The digital VTR data input object 208 also in- 
cludes message communicating means 1023, proc- 
essing retrieving means 1024, a method part 1025 
and an internal data part 1028. The internal data part 
1028 includies an object ID 1029 and link information 
1030. 



Fig. 28 is a view showing the structure of the dig- 
ital VTR data output object. The digital VTR data out- 
put object 209 shown in Fig. 28 includes a pointer-to- 
class-method-table storage part 1035 which store 

5 pointers to a data output class class method table 
1044. The data output class class method table 1044 
includes data reading means 1045, data transmitting 
means 1046 and link information updating means 
687. The digital VTR data output object 209 includes 

10 message communicating means 1 036, processing re- 
trieving means 1037, a method part 1038 and an in- 
ternal data part 1041. The internal data part 1041 in- 
cludes an object ID 1042 and link information 1043. 
When the digital VTR data input delegate object 

15 222 and the digital VTR data output delegate object 
223 of the digital VTR 203 is generated in the multi- 
media controller 1 , the digital VTR data input delegate 
object 222 and the digital VTR data output delegate 
object 223 function as if they were the digital VTR 

20 data input object 208 and digital VTR data output ob- 
ject209. For example, ifthefile of another multimedia 
device is to be copied to the digital VTR 203, the sys- 
tem director object 205 inquires the types of files 
which can be inputted of the digital VTR data input 

25 delegate object 222. In response to the inquiry of the 
system director object 205. the acceptable file type 
replying means 678 of the digital VTR data input del- 
egate object 222 replies the file types which can be 
received by the digital VTR 203. 

30 If the type of a file to be copied is contained in the 

replied file types, a link is set to connect the output 
delegate object of a multimedia device having the file 
to be copied to the digital VTR data input delegate ob- 
ject 222. The link information updating means 681 of 

35 the digital VTR data input delegate object 222 sends 
a message to the digital VTR data input object 208 
and activates the link information updating means 
686 of the digital VTR data input object 208, and the 
link information updating means 686 updates the link 

40 information 1030 of the digital VTR data input object 
208. 

Simultaneously, the data output delegate object 
of the multimedia device having the file to be copied 
sends a message for updating the link information of 

45 the data output object, whereby the link information is 
updated. Thus, a link is set between the data output 
object of the multimedia device having the file to be 
copied and the digital VTR data input object 208. 
After that, the data transmitting means of the 

50 data output object of the multimedia device having the 
file to be copied is activated, and the data output ob- 
ject of the multimedia device having the file to be cop- 
ied sends a message to the digital VTR input object. 
Thus, the data receiving means 1 033 and the file writ- 

55 ing means 1032 are activated to perform copying of 
the file. In other words, if a copy instruction or the like 
is inputted to both of the data input delegate object 
and the data output delegate object in the multimedia 
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controller, the data input delegate object and the data 
output delegate object respectively send messages to - 
the data input object and the data output object in 
each of the desired multimedia devices, thereby set- 
ting a data link between the multimedia devices Ac- s 
cordingly, the multimedia controller does not need to 
directly participate in an actual, data copying process 
or the like. 

As is apparent from the above description, in ac- 
cordance with the above-described embodiment, if w 
the entire system including a multimedia controller 
and a multiplicity of multimedia devices connected 
thereto is to be controlled, the software required to 
perform such control, stich as device drivers or appli- 
cation software, does not need to be installed or pre- is 
pared in the multimedia controller in advance Fur- 
ther, only if a desired multimedia device is connected 
to a LAN, a corresponding control panel and the state 
of the connected multimedia device are displayed on 
the display of the multimedia controller, whereby it is 20 
poss.ble to achieve great advantages; for example 
on the picture, it is possible to easily turn on and off 
a power source, to control the multimedia device, and 
to execute switching between input and output. ' 

In addition, some of the components of a control 25 
panel sent from a multimedia device to the multime- 
dia controller can be replaced with components hav- 
ing ident.cal definitions and provided in the multime- 
d.a controller in advance, to a user's taste. According- 
ly, it is possible to unify various user interfaces which 30 
differ among manufacturers. 

Further, control by a distant multimedia controller 
and access to multimedia devices can be transpar- 
ently executed via a LAN. 

Fig. 30 is a view showing the structure of the pan- 35 
el view setting menu object as well as the relationship 
between the structure and object description infor- 
mation. 

The panel view setting menu object 285 shown 
in Fig. 30 includes a pointer-to-class-method-table 40 
storage part 1428 which stores pointers to a menu 
class class method table 1430. The menu class class 
method table 1430 includes menu initializing means 
for initializing a menu object, menu graphic displaying 
means 1432 for graphically displaying a menu, and 45 
menu selection response means 1433 for displaying 
a response operation when a selection from the menu 
is performed. The panel view setting menu object 285 
also includes message communicating means 1429 
processing retrieving means 1434, a method part so 
1 435 and an internal data part 1 436. The internal data 
part 1436 includes an object ID 1437, menu state data 
1 438 and a graphical-display parameter 1439. The in- 
ternal data part 1436 is initialized in accordance with 
the digital VTR delegate object description file 210 55 
and the panel view setting menu description part of 
the digital VTR control panel object description part 
211 of the digital VTR delegate object description file 
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210 includes object recognition information 1440 
first object graphical-display information 1444 for dis- 
playing the title of a panel view setting menu, second 
object graphical-display information 1448 for display- 
ing a first menu item of the panel view setting menu 
and third object graphical-display information 1452 
for displaying a second menu item of the panel view 
setting menu. The object recognition information 
1440 includes a class name 1441 (in this example a 
menu class), an object 1442 (in this example, ID = 2) 
and an object ID 1443 of an object to which the object 
belongs (in this example, a digital VTR control panel 
of ID - 1). The first object graphical-display informa- 
hon 1444 includes graphical-display position and size 
information 1445, shape and color information 1446 
and an object image 1447. and represents a menu ti- 
tle 1462. The second object graphical-display infor- 
mation 1448 includes graphical-display position and 
size information 1449, shape and color information 
1450 and an object image 1451, and represents a 
first menu item 1463. The third object graphical-dis- 
play information 1452 includes graphical-display pos- 
ition and size information 1453, shape and color infor- 
mation 1454 and an object image 1455. and repre- 
sents a second menu item 1464. First object link in- 
formation 1456 describes a message to be issued 
when the first menu item 1463 is selected as well as 
a receiver to which the message is to be sent. The link 
target object ID 1457 is the ID of the system director 
object 205, and a sending message 1458 represents 
the message "Create object with file "Default"". Sec- 
ond object link information 1459 describes a message 
to be issued when the second menu item 1464 is se- 
lected as well as a receiver to which the message is 
to be sent. An link target object ID 1460 represents the 
ID of the system director object 205, and a sending 
message 1461 represents the message "Create ob- 
ject with file "Customl "". 

Fig. 31 is an explanatory view showing that the 
system director object 205 has the function of select- 
ing one file from a plurality of files when the system 
director object 205 is to read a multimedia device del- 
egate object description file. In Fig. 31, reference nu- 
meral 1465 denotes a digital VTR delegate object de- 
scnption file named "Default", and reference numeral 
1466 denotes a digital VTR delegate object descrip- 
tion file named "Customl". 

Fig. 32 is a view showing the way in which a user 
switches the control panel. Fig. 33 is a view showing 
a picture which appears after the switching of the con- 
trol panel. 

As shown in Fig. 32. in the case of a default set- 
ting, since the system director object 205 reads the 
digital VTR delegate object description file 1465 
named "Default" and generates the digital VTR con- 
trol panel object 221, the digital VTR control panel 
display picture 231 is displayed in its default state and 
the panel view setting menu 232 is set to "Default" If 
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a user selects "Customl" of the panel view setting 
menu 232 with the cursor 230 of the pointing device, 
the panel view setting menu object 285 sends the 
message "Create object with file "Customl"" to the 
system director object 205 by the menu selection re- 5 
sponse means 1433. In response to the message, the 
system director object 205 discards and regenerates 
the digital VTR delegate object 220 through the mul- 
timedia device delegate object generating means 
1047. At this time, the system director object 205 10 
reads the digital VTR delegate object description file 
1466 named "Customl" and regenerates the digital 
VTR control panel object 221 on the basis of the dig- 
ital VTR delegate object description file 1466. A con- 
trol panel which is apparently different from the digi- 15 
tal VTR delegate object description file 1465 named 
"Default" is written into the digital VTR delegate object 
description file 1466 named "Customl*, whereby it is 
possible to display an apparent, second control panel 
display picture 233 as shown in Fig. 33 by way of ex- 20 
ample. 

In the example shown in Fig. 33, the corners of 
the frame are rounded, the button displays are shad- 
owed and the Japanese text displays are substituted 
for the English text displays. However, according to 25 
the present invention, it is possible to meet a variety 
of users' demands by preparing various delegate ob- 
ject description files. 

Figs. 34(a) and 34(b) are views showing different 
examples of the arrangement of manipulating but- 30 
tons. In general, the arrangements of manipulating 
buttons of electrical equipments as well as multime- 
dia devices differ among manufacturers, and may 
even differ among products manufactured by a single 
manufacturer. This fact confuses users. If a user who 35 
is familiarized with the manipulation of a particular de- 
vice purchases a new device, the user needs to learn 
the manipulation of the new device. In accordance 
with the present invention, it is possible to easily 
change the arrangement of manipulating buttons by 40 
modifying a delegate object description file, and 
users can be allowed to select a desired one from 
among a plurality of arrangements. 

If application software is provided which allows a 
user to modify the arrangement of manipulating but- 45 
tons through an interactive manipulation and causes 
a delegate object description file to reflect the result 
of the modification, users become able to freely cus- 
tomize control panels to their tastes. For example, if 
a company or a third party, which provides the multi- so 
media controller 1, provides various multimedia de- 
vice delegate object description files, the arrange- 
ments of manipulating buttons of multimedia devices 
which differ among individual companies, for exam- 
ple, the arrangement of Fig. 34(a) adopted by a com- 55 
pany A and the arrangement of Fig. 34(b) adopted by 
a company B, can be unified in accordance with the 
policy of the company or the third party which pro- 



vides the multimedia controller 1. 

An increase in the functional level of multimedia 
devices is another cause of the confusion of users. 
Specifically, if manipulating members for functions 
which are normally not used by ordinary users or 
which can only be used by users having technical 
knowledge are displayed on a control panel, the ordi- 
nary users may become unable to easily use multi- 
media devices. To solve such a problem, the present 
invention also makes it possible to display only the 
manipulating members needed by a user. 

Fig. 35 shows the control panel display picture of 
a digital VTR having high-level functions. As shown in 
Fig. 35, a control panel display picture 276 to be used 
for manipulating functions which contain additional 
functions includes sliders 277 and 280 for manually 
adjusting sound recording levels, respectively, and 
level meters 278 and 279 for monitoring the respec- 
tive sound recording levels. A button group 281 for 
setting a desired image compression mode includes 
a default compression mode setting button 282 and 
an MPEG (an internationally standardized, moving- 
image compression system) compression mode set- 
ting button 283. These manipulating members merely 
confuse users who do not need such high-level func- 
tions. 

It is possible to perform switching between the 
control panel display picture 231 for manipulating 
only the minimum required functions and the control 
panel display picture 276 for manipulating functions 
which containing additional functions, by means of 
the control mode switching object 294. Specifically, if 
the user selects the advanced button 268 shown in 
Fig. 35 by using the pointing device, the system direc- 
tor object 205 reads a digital VTR control panel dele- 
gate object description file which describes the con- 
trol panel display picture 276 for manipulating the 
functions which contains the additional functions, to 
generate a control panel object for manipulating the 
functions which contains the additional functions. If 
no additional functions are needed, the user similarly 
selects the default button 267 shown in Fig. 35 by us- 
ing the pointing device, so that the system director ob- 
ject 205 reads a digital VTR control panel delegate 
object description file which describes the control 
panel display picture 231 for manipulating the mini- 
mum required functions, to regenerate a control pan- 
el object for manipulating the minimum required func- 
tions. 

In the above-described example, a plurality of 
multimedia device delegate object description files 
are employed for selecting a plurality of GUIs. How- 
ever, it is also possible to describe a plurality of GUIs 
in the multimedia device control panel object of a sin- 
gle multimedia device delegate object description 
file. 

As is apparent from the above description, in ac- 
cordance with the above-described embodiment, to 
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control the entire system including a controller and a 
plurality of multimedia devices connected thereto, it is 
not necessary to install and prepare, in the controller, 
device drivers, application software or the like for 
controlling the entire system. Only if a desired multi- s 
media device is connected to a LAN, a corresponding 
control panel and the state of the connected multime- 
dia device are displayed on the picture of the control- 
ler, whereby users can perform various operations on 
the picture, such as the operation of turning on and 10 
off the power source of the multimedia device, the op- 
eration of controlling the multimedia device itself and 
the operation of switching the inputting and the out- 
putting of data therebetween. 

In addition, by selecting a desired one from is 
among a plurality of GUI descriptions when a control 
panel is to be generated, not only is it possible to unify 
various user interfaces which differ among makers, 
but also each individual user can select a desired GUI 
to the user's taste and also edit the selected GUI. Fur- 20 
ther, since it is possible to display only the required 
manipulating members in accordance with the manip- 
ulation of the user, the user can easily manipulate the 
control panel. 

A second embodiment of the present invention 25 
will be described below. 

The second embodiment is intended to provide 
an environment which makes it possible to transpar- 
ently use multimedia devices in a common manner 
through a controller via a LAN without the need for 30 
special software such as application software or a 
device driver. Further, the second embodiment is in- 
tended to make it possible to construct, for communi- 
cation of data between the multimedia devices, a data 
sending and receiving relationship between the mul- 35 
timedia devices by means of a user interface which 
can be easily manipulated by a user, thereby enabling 
the multimedia devices to communicate data there- 
between without passing the data through the con- 
troller during an actual data communication. 40 

To achieve the above objects, in accordance with 
the second embodiment, there is provided a system 
which comprises a plurality of multimedia devices and 
a controller for controlling the plurality of multimedia 
devices. The plurality of multimedia devices and the 45 
controller are connected to a network in such a man- 
ner that the plurality of multimedia devices and the 
controller can communicate a message and data 
based on an object-oriented technique between each 
of the plurality of multimedia devices and the control- 50 
ler via the network. The controller includes display 
means for displaying icons representative of the re- 
spective plurality of multimedia devices, and pointing 
means for forming a link between arbitrary multime- 
dia devices selected from among the plurality of mul- 55 
timedia devices to specify a data input and output re- 
lationship between the arbitrary multimedia devices. 
According to this arrangement, a data sending 
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and receiving relationship between audio-visual de- 
vices can be constructed or modified merely by 
changing the internal data of an object which relates 
to the construction or modification of the data send- 
ing and receiving relationship, without the need to 
change the physical connection between the audio- 
visual devices. 

Control programs for individual objects do not 
need to be prepared in the controller in advance, and 
control of the objects can be realized merely by con- 
necting the objects to the controller. 

The controller allows a person who actually spe- 
cifies a desired control to display and manipulate con- 
trol means sent from a connected object, so that the 
person can manipulate through a single interface all 
the audio/visual devices connected to a network. 

Means for managing the connections between 
the individual devices is provided in the controller, 
and this managing means uses the display means to 
display the connection status of each of the devices. 
Accordingly, even if a multiplicity of connection rela- 
tionships are constructed, users can easily recognize 
the statuses of the respective connections. 

Regarding the system in which the multimedia 
devices and the controller are connected via the LAN, 
messaging to be executed when a user is to copy data 
from a digital camera to a digital VTR will be specifi- 
cally described below as a second embodiment It is 
assumed here that the digital camera referred to in 
the description of the second embodiment is of a han- 
dy type capable of outdoor recording of moving im- 
ages and sound and has communication means for 
communication with the system. 

Fig. 36(a) shows control panels to be displayed 
on a multimedia controller display. Reference numer- 
al 301 denotes a control panel for controlling a digital 
camera device, and reference numeral 310 denotes 
a control panel for controlling a digital VTR device. 
Each of the control panels 301 and 310 is displayed 
on the multimedia controller display by the previous- 
ly-described multimedia device control panel object 
description part (1062 in Fig. 7) being read from the 
corresponding one of the devices into the multimedia 
controller by a system director, and waits for an event 
to be specified by the user. 

Referring to Fig. 36(a), tape insertion display 
parts 302 and 311 display whether tapes are inserted 
in the respective devices. Counters 303 and 312 dis- 
play the running times of the tapes inserted in the re- 
spective devices. Button objects 304 and 313 are for 
displaying the lists of the contents of the tapes insert- 
ed in the respective devices, and when the button ob- 
ject 304 or 31 0 is clicked with a mouse, the list of the 
contents of the tape is displayed. When a Play button 
object 305 or 314 is clicked with the mouse, the cor- 
responding device executes a playback operation. 

When an FF button object 306 or 315 is clicked 
with the mouse, the corresponding device executes 
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fast forward feeding of the tape. When an RWD but- 
ton object 307 or 316 is clicked with the mouse, the 
corresponding device executes rewinding of the tape. 
When a stop button object 308 or 317 is clicked with 
the mouse, the corresponding device stops any of the 
Play, FF, RWD and Recfunctions. When the Rec but- 
ton object 309 or 318 is clicked with the mouse, the 
corresponding device starts to record video and audio 
data inputted from the outside via a communication 
medium such as a LAN. 

A procedure for dubbing video and audio data 
from the digital camera to the digital VTR by manipu- 
lating such a user interface will be described below 
with reference to Figs. 36(a) and 36(b). 

When the user starts to drag a mouse cursor in 
the control panel 301 of the user interface shown in 
Fig. 36(a), a black frame 319 is displayed as shown 
in Fig. 36(b). If the user continues the dragging on the 
control panel 301 and moves the mouse cursor out of 
the black frame 319, an arrow 321 is displayed to ex- 
tend in such a manner that the pointing head reaches 
the position of the mouse cursor. If the user further 
continues to move the mouse and the mouse cursor 
enters the inside of the frame of the control panel 310, 
a black frame 320 is displayed. If the user stops the 
dragging at this time, a link is formed to extend from 
the control panel 301 to the control panel 310. 

At this time, the multimedia controller determines 
whether the link is valid or invalid. If the link is invalid, 
the state of display returns to that shown in Fig. 36(a), 
whereas if the link is valid, the state shown in Fig. 
36(b) is maintained. 

Processing which is executed in the multimedia 
controller when the link is formed by the manipulation 
of the user will be described below with reference to 
Figs. 37, 38 and 39. 

Fig. 37 is a view showing the construction of in- 
ternal objects of each of a multimedia controller 322, 
a digital VTR device 338 and a digital camera device 
339 as well as the connection status of each of them. 

The objects in each of the multimedia controller 
322 and the devices 338 and 339 can communicate 
messages and data to each other. The objects of one 
of the multimedia controller 322 and the devices 338 
and 339 can also communicate messages with the 
objects which exist in another one of the multimedia 
controller 322 and the devices 338 and 339. by means 
of communication means 336, 406 and 407 via a LAN 
337. Each of the objects shown in Fig. 37 can com- 
municate messages and data with another arbitrary 
object. 

The object-to-object relationship between the ob- 
jects shown in Fig. 37 is represented by the object IDs 
of objects to which the respective objects belong, as 
described above in connection with the basic struc- 
ture of the objects. A system direction object 323 in- 
cludes a method part having means (data input/out- 
put managing means) 324 for determining whether in- 



put data and output data match each other when data 
outputted from one device is inputted to another de- 
vice. A connected device delegate object storage part 
335 is a part which stores the delegate object of each 

5 device created by connected device delegate object 
initializing means reading the predetermined informa- 
tion required for initialization from each device con- 
nected to the LAN 337 at the time of system activation 
and at predetermined time intervals. 

10 It is assumed here that the second embodiment 

is arranged to read initialization information from the 
digital VTR device 338, the digital camera device 339 
and other devices (none of which is shown in Fig. 37) 
which are connected to the LAN 337, and create a dig- 

15 ital VTR delegate object 326. a digital camera dele- 
gate object 331 and the objects of the other devices 
(none of which is shown in Fig. 37). A digital VTR data 
input delegate object 325 has answer means for an- 
swering an inquiry about the inputting of data into the 

20 digital VTR device 338. A digital camera data output 
delegate object 330 has answer means for answering 
an inquiry about the outputting of data from the digital 
camera device 339. A digital VTR device controller 
object 340 controls the hardware of the digital VTR 

25 device 338 in response to a message sent from an- 
other object. A digital camera device controller object 

341 controls the hardware of the digital camera de- 
vice 339 in response to a message sent from another 
object A digital VTR device data input object 408 has 

30 data receiving means capable of receiving data sent 
to its own object ID. A digital camera device data out- 
put object 409 has data sending means for adding in- 
formation, such as a data receiver ID, to data repro- 
duced by a reproducing device provided in a digital 

35 camera device (not shown) and sending the resultant 
data through the communication means 407. The 
communication means 336, 406 and 407 are provided 
for allowing the multimedia controller 322, the digital 
VTR device 338 and the digital camera device 339, all 

40 of which are connected to the LAN 337. to communi- 
cate with one another. 

Fig. 11 shows the structure of the system director 
object 323. When the processing retrieving means 

342 receives from the window server an information 
45 message which indicates that a link is formed be- 
tween devices by the input of a user, the processing 
retrieving means 342 activates the data input/output 
managing means 343. The data input/output manag- 
ing means 343 performs a series of processings for 

so making a decision as to the matching of data between 
the devices linked by the user. 

Fig. 38 is a flowchart showing the processing pro- 
cedure of the data input/output managing means. If 
the user forms a link which extends from a device A 

55 to a device B, by means of a user interface such as 
those shown in Figs. 36(a) and 36(b), the window ser- 
ver sends the system director object (205 in Fig. 11) 
a message (linked message) which indicates that the 
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link has been formed to extend from the device A to 
the device B. The processing retrieving means (342 * 
in Fig. 11) receives the message and activates the 
data input/output managing means in the method 
part. s 

The procedure of processing which is executed 
by the data input/output managing means when the 
user forms the link from the device A to the device B 
will be described below with reference to the flow- 
chart of Fig. 38. 1Q 

In Step S1, the data input/output managing 
means inquires an acceptable file type of the output 
delegate object of the device A (if there are a plurality 
of acceptable file types?, a list of the acceptable file 
types is replied). 

In Step S2, the data input/output managing 
means inquires an acceptable file type of the input 
delegate object of the device B. If there are a plurality 
of acceptable file types (acceptable formats) for the 
device B, the input delegate object of the device B 20 
sends information indicative of the priority of each of 
the file types to the data input/output managing 
means. Incidentally, the priority indicates the order of 
file types which can be suitably inputted into the de- 
vice B, the order being specified by the manufacturer 25 
of the device B or the user. A file type of highest pri- 
ority is herein referred to as the "highest-priority file 
type for the device B". Then, in Step S3, an accept- 
able file type (or an acceptable file type list) for the 
device A is searched for in accordance with the prior- 30 
ity of the device B. Specifically, a highest-priority file 
type for the device B is searched for from among the 
acceptable file types for the device A which have 
been read in Step S1. The file type which has been 
obtained through this processing is hereinafter refer- 35 
red to as an optimally acceptable file type for the de- 
vice A and the device B. 

If, in Step S4, the data input/output managing 
means fails to search for an acceptable file type in 
Step S3, i.e., if the same file type does not coexist in 40 
the device A acceptable file type list and the device 
B acceptable file type list, the process proceeds to 
Step S8. If the data input/output managing means 
succeeds in searching for the same file type, the 
process proceeds to Step S5. It is determined in Step 45 
S5 whether the data attribute of the optimally accept- 
able file type obtained in Step S3 coincides with the 
data attribute of the high est- priority file type for the 
device B. If a coincidence is obtained, the process 
proceeds to Step S6. 50 

In Step S6, it is determined that the present link 
is valid, and information indicating that the valid link 
has been formed to extend from the device A to the 
device B, and the data attribute and the file type of 
the present link are saved in the device-to-device link 55 
information management data part (344 in Fig. 11) 
which exists in a system director object internal data 
part. 



In Step S7, the data input/output managing 
means informs a linked message sender object, the 
output delegate object of the device A and the input 
delegate object of the device B of the fact that the val- 
id link has been formed to extend from the device A 
to the device B, as well as of the file type of the pres- 
ent link. Then, the data input/output managing means 
brings a series of processings to an end. 

If no coincidence of the acceptable file types is 
obtained in Step S4, the process proceeds to Step S8. 
in which it is determined that the present link is invalid! 
The data input/output managing means informs the 
linked message sender object that since no common 
format is present, the link is invalid. In Step S11, the 
data input/output managing means sends the linked 
message sender object a message indicative of a re- 
quest to erase the link, and brings the processing to 
an end. 

If the data attribute of the optimally acceptable 
f ile type and the data attribute of the highest-priority 
file type do not coincide with each other in Step S5, 
the process proceeds to Step S9, in which the data in- 
put/output managing means sends the linked mes- 
sage sender object a message indicative of a request 
to provide a warning display. This message has a 
content which inquires of the user whether the user 
can be satisfied with the communication of data 
based on the data attribute of the optimally accept- 
able file type, and serves as an event loop which 
waits for the user to input a decision as to whether the 
connection of the present link should be continued or 
cancelled. If the user specifies the continuation of the 
connection of the present link, the process proceeds 
to Step S6 through Step S10. If the user specifies the 
cancellation of the connection of the present link, the 
process proceeds to Step S11 through Step S10, and 
the data input/output managing means sends out a 
link erasure request message and bring a series of 
processings to an end. 

The procedure of processing which is executed in 
the multimedia controller when the user forms a link 
from the digital camera control panel (301 in Fig. 
36(a)) to the digital VTR control panel (310 in Fig. 
36(a), will be described more specifically with refer- 
ence to Figs. 36, 11 and 39. 

If the userforms the link 321 from the digital cam- 
era control panel to the digital VTR control panel, as 
shown in Fig. 36(a), on the user interface shown in 
Fig. 36(a), the window server sends the system direc- 
tor object of Fig. 11 a message which indicates that 
the link has been formed from the digital camera con- 
trol panel to the digital VTR control panel. 

When the processing retrieving means 342 in the 
system director object receives this message, the 
processing retrieving means 342 activates the data 
input/output managing means 343 in the method part. 
The data input/output managing means 343 executes 
processing according to the flowchart of Fig. 39, and 
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executes the processing of determining whether the 
link formed between the digital camera control pane! 
and the digital VTR control panel is valid or invalid. 

In Step S1, the data input/output managing 
means 343 inquires an acceptable file type of the dig- 
ital camera output delegate object. The table shown 
in Fig. 51(a) is a list of a plurality of digital camera ac- 
ceptable file types according to the second embodi- 
ment. In Fig. 51(a), the acceptable file types are 
shown together with the respective data attributes. In 
Fig. 51 (a), the data attributes Audio, Movie and Audio 
& Movie respectively represent audio data, moving- 
image data, and audio and moving-image data which 
are synchronized. 

Then, in Step S2, the data input/output managing 
means 343 inquires an acceptable file type of the in- 
put delegate object of the digital VTR. The digital VTR 
used in the second embodiment can cope with a plur- 
ality of file types as shown in the table of Fig. 51(b), 
and informs the data input/output managing means 
343 of each of the file types together with the corre- 
sponding priority. In the second embodiment, as 
shown in Fig. 51(b), a file type AM4 corresponding to 
the data attribute Audio & Movie is a highest-priority 
file type for the digital VTR. 

Then, in Step S3, the data input/output managing 
means 343 searches for a coincident file type in the 
table shown in Fig. 51(a), in accordance with the pri- 
ority shown in the table of Fig. 51 (b). Since the format 
(file type) AM4 has the first priority as shown in the 
table of Fig. 51(b), the format AM4 is searched for in 
the table of Fig. 51(a). Since the table of Fig. 51(a) 
does not have the format AM4, a format AM5 of sec- 
ond highest priority is searched for in the table of Fig. 
51(a). 

If the search for the format AM 5 also fails, a sim- 
ilar search is repeated in accordance with the priority 
until a coincident file type is obtained. In the second 
embodiment, the data input/output managing means 
343 finds a coincident file type by making a search for 
a format Movie2 having the fourth highest priority, 
and adopts the format Movie2 as an optimally accept- 
able file type for a link to be formed from the digital 
camera to the digital VTR. 

Since the coincident file type has been found in 
the search of Step S3, the process proceeds from 
Step S4 to Step S5. 

Since the data attribute Movie of the optimally ac- 
ceptable file type Movie2 obtained in Step S3 and the 
data attribute Audio & Movie of the highest-priority 
file type for the digital VTR do not coincide with each 
other, the process proceeds from Step S5 to Step S9. 

In Step S9, the data input/output managing 
means 343 sends the window server a message in- 
dicative of a request to provide a warning display, 
such as that shown in Fig. 40, and enters a loop S12 
for waiting for the next input from the user. 

If the user clicks "YES" on the panel shown in Fig. 



40, the process proceeds from Step S10 to Step S6. 

In Step S6. data indicating that the valid link ac- 
cording to the data attribute Movie and the file format 
Movie2 has been formed from the digital camera to 

5 the digital VTR is saved in the device-to-device link in- 
formation management data (344 in Fig. 11) con- 
tained in the system director's internal data part. 

Finally, in Step S7, the data input/output manag- 
ing means 343 sends the digital camera output dele- 
to gate object and the digital VTRinput delegate object 
a message which) indicates that the link according to 
the file type Movie2 has been formed from the digital 
camera to the digital VTR. Then, the data input/output 
managing means 343 brings a series of processing to 

15 an end. 

The digital camera output delegate object (410 in 
Fig. 47), which has received the message from the 
data input/output managing object (343) in Step S7, 
activates the link information updating means (413 in 

20 Fig. 47) of its method part. The activated link informa- 
tion updating means (413 in Fig. 47) stores data indi- 
cative of the formation of the link from the digital cam- 
era to the digital VTR according to the format Movie2, 
in the link information (419 in Fig. 47) of its internal 

25 data part, and sends a message which indicates that 
the link information has been updated and a message 
indicative of the content of the updating to the digital 
camera data output object (420 in Fig. 48) having a 
corresponding data input object ID. The digital cam- 

30 era data output object (420 in Fig. 48) activates the 
link information updating means (425 in Fig. 48) and 
saves the updated content of the link in the link infor- 
mation (428 in Fig. 48). 

The digital camera output delegate object (410 in 

35 Fig. 47) grays out any object that does not relate to 
data output, from among all the objects which belong 
to the digital camera control panel object (333 in Fig. 
37), and sends a message indicative of an instruction 
to make the user's input impossible. In response to 

40 the message, the Rec button 309 shown in Fig. 36(b) 
is grayed out to reject the mouse click of the user. 

The digital VTR input delegate object (222 in Fig. 
25) which has received the message from the system 
director object activates the link information updating 

45 means 681. The activated link information updating 
means 681 saves data indicative of the formation of 
the link from the digital camera to the digital VTR ac- 
cording to the format Movie2, in the link information 
1 006 of the internal data part of the internal data part. 

so The link information updating means 681 also sends 
a message indicative of the updated content of the 
link information to the digital VTR data input object 
(208 in Fig. 27) having a corresponding data input ob- 
ject ID. The digital VTR data input object (208 in Fig. 

55 27) which has received the message activates the link 
information updating means (686 in Fig. 27) to save 
the updated content of the link information in the link 
information (1030 in Fig. 27). The digital VTR input 

19 



37 



EP 0 637 157 A2 



38 



delegate object (222 in Fig. 25) grays out any object 
that does not relate to data input, from among all the 
objects which belong to the digital VTR control panel 
object (328 in Fig. 37), and sends a message indica- 
tive of an instruction to make the user's input impos- s 
sible. 

In response to the message, the Play button 314 
the FF button 315 and the RWD button 316 shown in 
Fig. 36(b) are grayed out to reject the mouse click of 
the user, and the valid link is maintained in the state 10 
formed as shown in Fig. 36(b). 

Figs. 50(a) to 50(e) are the states of the respec- 
tive internal data parts obtained when the valid link is 
formed as shown in Fig. 36(b). Fig. 50(a) shows the 
internal data part of the digital camera output dele- 15 
gate object, Fig. 50(b) shows the internal data part of 
the digital VTR data input delegate object, Fig. 50(c) 
shows the internal data part of the digital camera data 
output object delegate, Fig. 50(d) shows the internal 
data part of the digital VTR data input object, and Fig 20 
50(e) shows the internal data part of the system direc- 
tor object In each of the internal data parts, the inter- 
nal variable updated as the result of the formation of 
the link by the user is shown in a square bracket. 

If the user clicks the Play button 305 of the control 25 
panel 301 with the valid link being formed as shown 
m Fig. 36(b) and the respective internal data parts be- 
ing in the states shown in Figs. 50(a) to 50(e), the dig- 
ital camera starts to transfer data according to the for- 
mat Movie2 to the digital VTR. 30 

Then, if the user clicks the Rec button 318, the 
digital VTR starts to record the data of format Movie2 
which is sent from the digital camera to the digital 
VTR, thereby executing device-to- device dubbing 
Messaging which is carried out between the internal 35 
part of the multimedia controller and each of the de- 
vices during this time will be described below. 

First of all, when the user clicks the Play button 
(305 in Fig. 36(b)), the window server informs the con- 
trol panel object (333 in Fig. 37) of the coordinates of 40 
the clicked position (the coordinates in the control 
panel). The control panel object which has received 
the coordinates refers to its own internal data part 
recognizes that the Play button is displayed at the co^ 
ordmates. and understands that the Play button has 45 
been clicked. The control panel object sends the dig- 
ital camera device controller object 341 a message in- 
dicating that a data sending instruction (Play Mes- 
sage) has been given by the user. The processing re- 
trieving means 431 in the digital camera controller ob- so 
ject (429 in Fig. 49) activates play executing means 
433 corresponding to the message in the method part 
432. The play executing means 433 controls the hard- 
ware of the digital camera to make the mechanical 
part of the digital camera ready to perform a play op- 55 
eration at any time. The play executing means 433 
also sends the digital camera device data output ob- 
ject (409 in Fig. 37) a message indicative of a request 
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to output reproduced data. The processing retrieving 
means (421 in Fig. 48) in the digital camera device 
data output object which has received the message 
activates the data reading means 423 and the data 
transmitting means 424 in the method part 422 The 
activated data reading means 423 reads information 
from a recording medium. 

The activated data transmitting means 424 first 
refers to the link information 428. Since the contents 
of the link information 428 represent a data receiver 
object ID = 120 and a file type = Movie2 as shown at 
430 in Fig. 50(c), the data transmitting means 424 
converts the file type of the read data into the file 
type Movie2, and then sends the data of the file type 
Movie2 to the data receiver object of ID = 120. In the 
second embodiment, the data Movie2 represents 
moving-image data. As shown in Fig. 42, the leading 
part of serial data is formed as a header part which in- 
cludes the data required to reproduce a moving im- 
age, such as a file type and the numbers of vertical 
and horizontal pixels, while the body part of the serial 
data is divided into small segments by time stamps in- 
dicative of time information. The user can edit each 
of the small segments defined by the time stamps. 

If the digital VTR device data input object (208 in 
Fig. 27) of ID = 120 detects that the Movie2 data has 
been sent from the object of ID = 110, the digital VTR 
device data input object refers to its own link informa- 
tion (1030 in Fig. 27). If the digital VTR device data in- 
put object confirms that there is a link between the 
data output object of ID = 1 00 and the file type Movie2 
as shown at 431 in Fig. 50(d), the header part (364 in 
Fig. 42) of the sent data is stored in a memory (370 
in Fig. 43). 

If the user clicks the Rec button (31 8 in Fig. 36(b)) 
of the digital VTR control panel at a particular time, 
the window server informs the control panel object 
(328 in Fig. 37) of the coordinates of the clicked pos- 
ition (the coordinates in the control panel). The con- 
trol panel object which has received the coordinates 
refers to its own internal data part, recognizes that the 
Rec button is displayed at the coordinates, and un- 
derstands that the Rec button has been clicked. The 
control panel object sends the digital VTR device con- 
troller object 340 a message indicating that a data re- 
cording instruction (Rec Message) has been given by 
the user. The processing retrieving means (1011 in 
Fig. 15) in the digital VTR controller object activates 
the recording executing means (1020 in Fig. 15) in the 
method part. The activated recording executing 
means (1020 in Fig. 15) controls the hardware of the 
digital VTR to make the mechanical part of the digital 
VTR ready to perform a recording operation at any 
time. The recording executing means also sends the 
digital VTR data input object (208 in Fig. 27) a mes- 
sage indicative of a request to record input data. The 
digital VTR data input object (208 in Fig. 27) which 
has received the request for recording of input data 



BNSDOCID: <EP I > 



39 



EP 0 637 157 A2 



40 



controls the hardware of the digital VTR to read the 
head information (364 in Fig. 42) saved in the RAM 
(370 in Fig. 43). The digital VTR data input object in- 
serts, after the header information, data which fol- 
lows a time stamp to be sent immediately after the s 
head information, and starts recording on a magnetic 
recording medium 369. The thus-recorded Movie2 
moving-image data has the header information re- 
quired for moving-image play, so that it is possible to 
reproduce the moving-image data. 10 

A third embodiment of the present invention will 
be described below. A multimedia controller accord- 
ing to the third embodiment has the feature described 
previously in connection with the first embodiment, 
and an application software (utility software) operat- is 
ing environment. 

The multimedia controller according to the third 
embodiment will be described below. (In the present 
invention, there is no essential difference between 
application software and utility software, and the 20 
term "application software" is hereinafter used to rep- 
resent application software and utility software.) 

Fig. 45 shows the construction of internal objects 
of the multimedia controller according to the third em- 
bodiment of the present invention. The multimedia 25 
controller according to the third embodiment of the 
present invention includes means for installing appli- 
cation software (utility software) for the multimedia 
controller and an application software operating en- 
vironment (In the present invention, there is no es- 30 
sential difference between the application software 
and the utility software, and the term "application 
software" is hereinafter used to represent the appli- 
cation software and the utility software.) 

In the multimedia controller according to the third 35 
embodiment, the application software is installed in 
an application class storage part (388 in Fig. 45) pro- 
vided in the multimedia controller, from a floppy disk, 
communication means or the like. The content of the 
application software stored in the application class 40 
storage part is the description file of a class based on 
an object-oriented technique, and application object 
generating means (386 in Fig. 45) provided in the sys- 
tem direction object employs this class to generate an 
object capable of executing the application software, 45 
in an application object operation area (389 in Fig. 
45). Thus, the application software becomes execu- 
table. If a user executes a manipulation using pointing 
means, such as a mouse, on a visible window object 
graphically displayed on a multimedia controller dis- so 
play by the application object, a window server sends 
to the application object a message indicating what 
manipulation has been executed at which coordinates 
on the multimedia controller display. Since the appli- 
cation object holds in its own internal data part infor- 55 
mation indicating what graphics are present at which 
coordinates on the application window, the applica- 
tion object can employ the information sent from the 



window server to recognize a click of an icon on the 
application window, an icon-to-icon dragging opera- 
tion and the like. 

A connection constructer application will be de- 
scribed below as one specific example of the appli- 
cation software for the multimedia controller. 

Fig. 44 shows the user interface of the connec- 
tion constructer. As shown in Fig. 44, a connection 
constructer window 370 includes a cursor 379 of a 
mouse which is inputting means manipulated by a 
user, a CD player icon 371 , a VTR icon 372, a display 
icon 373, a CA-TV decoder icon 374, a DAT deck icon 
375, an amplifier icon 376 representative of an ampli- 
fier for amplifying an audio signal and causes a 
speaker (not shown) to generate sound, an MO player 
icon 377 representative of a magneto-optical player 
for performing recording on and play from a magneto- 
optical disk, a multimedia controller icon 378, and an 
LD player icon 383. The data sending and receiving 
relationships (connections) between the individual 
devices are indicated by arrows, and the user can 
easily known the data sending and receiving relation- 
ships between the individual devices owing to the ar- 
rows. 

In the third embodiment, the LD player (383 in 
Fig. 44) has no connection. If the LD player which is 
in this state is made to perform a play, the reproduced 
video and audio data are sent to an object for provid- 
ing a video display and an audio output, which object 
is provided in the multimedia controller which a de- 
fault link target. 

The connection constructer window displayed in 
this manner is not only capable of displaying the 
aforesaid connections, but also allows the user to edit 
the connections on the connection constructer win- 
dow. The user can form a connection between de- 
sired icons by dragging the cursor 379 therebetween. 
Fig. 44 shows a halfway stage in which the user is 
forming a connection from the CD player 371 to the 
amplifier 376 while dragging the mouse. 

If the user clicks the icon of the connection con- 
structer (connection constructer object) displayed on 
the multimedia controller display (27 in Fig. 4), the 
window server sends a connection constructer object 
(390 in Fig. 45) a message indicating that the icon has 
been clicked. The connection constructer object 
which has received the message activates connec- 
tion constructer window displaying means (391 in Fig. 
45) by means of processing retrieving means which 
is not shown in Fig. 45. 

Messaging which is executed between the indi- 
vidual objects in the multimedia controller via the con- 
nection constructer object 390 when the user clicks 
the icon of the connection constructer, will be descri- 
bed below with reference to the flowchart of Fig. 46. 

In Step S1, the connection constructer window 
displaying means (391 in Fig. 45) requests the sys- 
tem director object (205 in Fig. 1 1) to send a list of the 
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object IDs of all the devices connected to the network. 
In Step S2, the connection constructer window dis- 
playing means waits for data corresponding to the re- 
quest message to be sent from the system director 
object. The system director object refers to the object 
registration information (1078 in Fig. 11) stored in its 
own internal data part and retransmits a list of regis- 
tered device object IDs to the connection constructer 
window displaying means. The connection construct- 
er window displaying means stores the list in its inter- 
nal data part, and causes the process to proceed to 
Step S3. 

In Step S3, the connection constructer window 
displaying means refers to the internal data part and 
sends a icon graphics data sending request message 
to all the objects having the respective object IDs de- 
scribed in the connected device object ID list stored 
in the internal data part. In Step S4, the process waits 
for the data to be sent. If graphics data are sent from 
all the object having the respective object IDs, the 
connection constructer window displaying means 
stores the graphics data in the internal data part, and 
causes the process to proceed to Step S5. In Step S5, 
the connection constructer window displaying means 
sends the data input/output managing object a mes- 
sage indicative of a request to send device-to-device 
link information which indicates that links are formed 
from which object ID to which object ID as well as 
what data attributes the respective links have. In Step 

56, if the connection constructer window displaying 
means receives the device-to-device link information, 
it is determined that the connection constructer object 
390 has obtained enough information to display the 
connection constructer window 370 of Fig. 44. In Step 

57, the connection constructer window displaying 
means performs the processing of graphically dis- 
playing the connection constructer window 370. Such 
graphical display is executed on the basis of icon dis- 
play positions which are calculated so that the prob- 
ability that links cross each other can be made as low 
as possible. 

In the third embodiment, the links formed be- 
tween the devices are represented by straight lines 
connecting the icons of the respective devices, as 
shown in Fig. 44, so that the user can easily know the 
status of each connection. (The links do not need to 
be represented by such straight lines, and curved 
lines or others may also be employed for the purpose 
of more clearly displaying the relationship of connec- 
tions.) Data attributes valid for the respective links 
are identified on the basis of the kinds (or colors) of 
lines. 

In the third embodiment, as shown in Fig. 44 t a 
link for visual data is displayed by a solid line, a link 
for audio data is displayed by a dashed line, a link for 
an application program is displayed by a chain line, 
and a link for text data is displayed by a chain double- 
dashed line. 
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For example, in Fig. 44, the VTR icon 372 and the 
display icon 373 are connected by a solid arrow 381 
This indicates that if play from the VTR is executed, 
video data reproduced from the VTR is automatically 
transmitted to the display. If the user desires to enjoy 
the CA-TV, the user needs only to open a control pan- 
el for the CA-TV and set a desired channel. Video 
data from the CA-TV is automatically transmitted to 
the ID of the display 373, while audio data from the 
CA-TV is automatically transmitted to the ID of the 
amplifier 376. 

In the third embodiment, the data supplied from 
the MO player is program data, and when the program 
data is transferred to the multimedia controller, the 
multimedia controller detects the description "pro- 
gram- contained in the data attribute described in the 
header part of the program data and recognizes the 
received data as an application program, whereby 
this application program is automatically activated. 
The above-described function can be realized in not 
only the multimedia controller but also other kinds of 
devices. For example, an operating system may also 
be provided in the display so that when the display re- 
ceives a program, it can execute the program. 

In the third embodiment, video data is embedded 
in the program, and an image is displayed on the dis- 
play by executing the program. The advantage of this 
process is that since the video data is embedded in 
the program, users do not need to be conscious of 
data formats acceptable to the respective devices. 

The user can edit the data sending and receiving 
relationships between the respective devices by 
forming lines between the respective device icons 
displayed on the aforementioned window. If a connec- 
tion is formed between particular icons, connection 
editing means 394 transmits a linked message to the 
system director object. The system director object 
which has received the linked message executes 
processing in accordance with the flowchart of Fig. 39 
in a manner similar to that described in connection 
with the first embodiment. If the data input/output 
managing means in the system director object deter- 
mines that the link is valid, the internal data part of an 
object which relates to the link is updated in a manner 
similar to that described in connection with the first 
embodiment. 

In Step S7 of Fig. 39. the connection constructer 
object is informed of the data attribute of the link 
formed by the system director object, and the connec- 
tion constructer object selects and displays the kind 
of line of the link in accordance with the data attribute. 
The content of the internal data part of the object 
which relates to the updating of the link and the con- 
tent displayed on the connection constructer window 
always coincide with each other. 

As is apparent from the above description, in ac- 
cordance with the above-described system device 
controlling means according to the third embodiment, 
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to control the entire system including a controller and 
a plurality of multimedia devices connected thereto, 
it is not necessary to install and prepare, in the con- 
troller, device drivers, application software or the like 
for controlling the entire system. Only if a desired mul- 
timedia device is connected to a LAN, a correspond- 
ing control panel and the state of the connected mul- 
timedia device are displayed on the picture of the con- 
troller, whereby users can perform various operations 
on the picture, such as the operation of turning on and 
off the power source of the multimedia device, the op- 
eration of controlling the multimedia device itself and 
the operation of switching the inputting and the out- 
putting of data therebetween. In addition, users can 
construct data sending and receiving relationships 
between the multimedia devices by means of a sim- 
ple user interface. Since the controller (multimedia 
controller) automatically makes adjustment of the file 
format of data between a sending device and a receiv- 
ing device, users do not need to perform a trouble- 
some manipulation, such as adjustment of a file for- 
mat. 

Afourth embodiment of the present invention will 
be described below in detail. 

The fourth embodiment relates to a multimedia 
device controlling system including multimedia devic- 
es and a multimedia controller for controlling the mul- 
timedia devices and, more particularly, to a system 
for confirming, managing and manipulating the con- 
nection status of, and the on/off state of the power 
source of, each of the multimedia devices to be con- 
trolled by the multimedia controller. 

In recent years, various devices, such as VTRs, 
CDs and other AV devices, have been being digitized, 
and it has been desired to regard such digitized de- 
vices as so-called multimedia devices and employ in- 
formation, such as images, sounds and texts in an in- 
tegrated manner. Conventionally, a user has taken 
the responsibility of managing the connection of such 
multimedia devices, and to handle the information in 
an integrated manner, a device for managing and con- 
trolling the multimedia devices has been needed. 

To achieve the above-described concept, there is 
a system in which an information processing device, 
such as a computer, and a printer or the like are con- 
nected by a network. 

In this system as well, to accurately and efficient- 
ly manage and operate connected devices, an infor- 
mation processing device (hereinafter referred to as 
the "multimedia controller") for managing and control- 
ling the connected devices needs to correctly confirm 
the statuses of the respective connected devices. 
The following confirmation techniques are employed: 
(1) a technique in which identification information 
about the respective multimedia devices con- 
nected to the system is manually inputted to the 
storage device of the multimedia controller and, 
when the power source of the multimedia control- 



ler is turned on, the multimedia controller reads 
and confirms the identification information; 

(2) a technique in which identification information 
about the respective multimedia devices con- 

5 nected to the system is manually inputted to the 

storage devices of the respective multimedia de- 
vices and, when the power source of the multime- 
dia controller is turned on, the multimedia con- 
troller reads out and confirms the identification 

10 information through communication; and 

(3) a technique in which the multimedia controller 
checks the multimedia devices connected to the 
system in accordance with the manipulation of a 
user and assigns identification information about 

15 the respective connected multimedia devices to 

the storage devices of the respective multimedia 
devices. 

However, any of the above-described conven- 
tional arts relates to the art of computer systems, and 

20 users need to have skill or knowledge about computer 
systems. This leads to the problem that any of the 
above-described conventional arts is not acceptable 
to common users who use VTRs, CD players or other 
domestic devices. 

25 For example, in the conventional art (1), it is nec- 

essary to manually input information about the con- 
nected multimedia devices to the multimedia control- 
ler in advance, so that a manager who has inputted 
the information must manage predetermined informa- 

30 tion, such as information indicating what identifica- 
tion information has been assigned to which multime- 
dia device. As a result, the manager needs to accu- 
rately manage the predetermined information, and it 
is also impossible to avoid the occurrence of malf unc- 

35 tion due to erroneous inputting or the like. If a multi- 
media device is to be newly connected to the system, 
it is necessary to request the manager to newly as- 
sign identification information to all the connected 
multimedia devices and input the assigned identifica- 

40 tion information to the multimedia controller. 

In the conventional art (2), although the multime- 
dia controller assigns the identification information to 
the respective multimedia devices, it is still neces- 
sary to manually input the identification information 

45 to the respective multimedia devices to be connected 
to the system. Accordingly, it is still impossible to 
avoid the occurrence of malfunction due to erroneous 
inputting. 

In either of the arts (1) or (2), if a multimedia de- 
50 vice is newly connected to, or disconnected from, the 
system with the system being activated, the system 
is unable to recognize that fact. For this reason, it is 
necessary to shut down the system and then re-acti- 
vate it to cause the system to correctly recognize the 
55 connected multimedia devices. 

In the case of the art (3), the above-described 
problems are solved to a considerable extent For ex- 
ample, even if a multimedia device is newly connect- 
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■ ed to, or disconnected from, the system with the sys- 
tem being activated, the system can recognize that 
fact without being shut down and re-activated. How- 
ever , a user of the system must perform the operation 
of issuing a command to confirm the multimedia de- 5 
vices connected to the system to the multimedia con- 
troller. As a result, the user must be at all times con- 
scious that a multimedia device has been connected 
to, or disconnected from, the system, and must per- 
form the aforesaid command issuing operation each 10 
time a multimedia device has been connected to, or 
disconnected from, the system. 

The above-described problems lead to the prob- 
lem that none of the conventional systems is accept- 
able to common users having no special skill or 15 
knowledge about computer systems. 

The fourth embodiment has been made to solve 
the above-described problems, and is intended to dis- 
close an improved multimedia system which includes 
multimedia devices and a multimedia controller for 20 
unitarily managing the multimedia devices. In the 
multimedia system, each of the multimedia devices 
includes a first interface control unit which functions 
to exercise control over communication with the mul- 
timedia controller, and the first interface control unit 25 
includes an interface controller for controlling com- 
munication at a physical or logical low level, and a first 
system controller for executing communication with a 
device function unit of the multimedia device and con- 
trol of the first interface control unit The multimedia 30 
controller includes a second interface control unit for 
controlling communication with each of the multime- 
dia devices, and the second interface control unit in- 
cludes an interface controller for controlling commu- 
nication at a physical or logical low level, device con- 35 
nection/disconnection signal processing means for 
processing a device connection signal indicative of a 
connection of any of the multimedia devices detected 
by the interface controller or a device disconnection 
signal indicative of a disconnection of any of the mul- 40 
timedia devices detected by the interface controller, 
storage means for storing a state-of-connection man- 
agement table which is to be referred to and updated 
in the device connection/disconnection signal proc- 
essing means, and a second system controller for 45 
executing communication with the device function 
unit of the multimedia controller and control of the 
second interface unit. 

According to the above-described embodiment, 
users can correctly grasp the state of connection be- so 
tween the multimedia controller and each of the mul- 
timedia devices without being particularly conscious 
of the connection or disconnection of any of the mul- 
timedia devices. Accordingly, even if a multimedia 
device is newly connected to, or disconnected from, 55 
the multimedia controller, the total efficiency of the 
system is not impaired. 

The fourth embodiment of the present invention 

24 



will be described below with reference to a specific 
example in which a plurality of multimedia devices are 
connected to a multimedia controller so that they can 
be controlled by using a multimedia control system. 
Fig. 52 is a block diagram showing the construction 
of the fourth embodiment. 

As can be seen from Fig. 52, the fourth embodi- 
ment of the present invention includes multimedia de- 
vices 102-1, 102-2 and 102-3 and the multimedia 
controller 1 for manipulating and managing the mul- 
timedia devices 102-1, 102-2 and 102-3. 

Although Fig. 52 shows the three multimedia de- 
vices 102-1, 102-2 and 102-3 by way of example, it is 
of course possible to employ one or more multimedia 
devices. However, the maximum allowable number of 
connectable multimedia devices are determined by a 
total load which can be handled by the entire system. 

The multimedia controller 1 includes a multime- 
dia controller function unit 103 for realizing the func- 
tion of the multimedia controller 1, an interface con- 
troller 107-0 for controlling communications at a 
physical or logical low level, a main power source cir- 
cuit 108-0, a subsidiary power source circuit 109-0, a 
timer circuit 105, a memory 104 which stores a table 
for managing the connection statuses of the respec- 
tive multimedia devices 102-1, 102-2 and 102-3, and 
a system controller 106-0 for controlling those con- 
stituent elements. The main power source circuit 108- 
0 supplies electrical power to each of the interface 
controller 107-0, the timer circuit 105, the system 
controller 106-0 and the memory 104. Such electrical 
power may also be supplied from a battery, or a pow- 
er source line may be added to a communication line 
to supply the electrical power. The subsidiary power 
source circuit 109-0 is arranged to be turned on and 
off by a user manipulating the main switch of the mul- 
timedia controller 1 or in accordance with a request 
sent from the system controller 106-0, and the elec- 
trical power of the subsidiary power source circuit 
109-0 is supplied to the multimedia controller func- 
tion unit 103. The subsidiary power source circuit 
109-0 uses, for example, a domestic wall socket, 
whereas the main power source circuit 108-0 uses an- 
other power source line. 

Since electrical power can be supplied from such 
two different power source lines in the above- 
described manner, a power source for a mechanism 
driving system which generally has a large power con- 
sumption needs only to be turned on when required, 
and if such a power source is not required, it is pos- 
sible to supply enough electrical power to execute 
only communication. 

The multimedia devices 1 02-1 (A), 102-2 (B) and 
102-3 (C) respectively include multimedia function 
units 111-1, 111-2 and 111-3, interface controllers 

107- 1, 107-2 and 107-3, main power source circuits 

1 08- 1 , 1 08-2 and 1 08-3, subsidiary power source cir- 
cuits 109-1, 109-2 and 109-3 and system controllers 
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106- 1, 106-2 and 106-3. The interface controllers 

107- 1, 107-2 and 107-3, the main power source cir- 
cuits 108-1, 108-2 and 108-3, the subsidiary power 
source circuits 109-1, 109-2 and 109-3 and the sys- 
tem controllers 106-1, 106-2 and 106-3 are respec- 
tively equivalent to the interface controller 107-0, the 
main power source circuit 108-0, the subsidiary pow- 
er source circuit 109-0 and the system controller 106- 
0. 

Fig. 53 is a block diagram showing the construc- 
tion of a digital VTR which is a specific example of any 
one of the multimedia devices A, B and C. A digital 
VTR function unit 111 which is a specific example of 
any one of the multimedia function units 111-1, 111- 
2 and 111-3 includes an analog output terminal 113, 
an analog input terminal 114, a D/ A conversion circuit 
115, an A/D conversion circuit 116, a frame memory 
117, a signal processing circuit 118, a coding circuit 
119, a decoding circuit 120, a tape deck unit 122, a 
tape interface controller 121, a high-speed data bus 
123 and a control bus 124. 

The operation of the fourth embodiment of the 
present invention will be described below. Fig. 54 is 
a flowchart showing the processing of a main event 
loop of the multimedia controller 1 . First of all, it is de- 
termined whether there is an event caused by the ma- 
nipulation of the multimedia controller 1 by a user who 
is manipulating the multimedia controller 1 or an 
event sent from any of the multimedia devices 
through communication (S101). If there is either 
event, the processing of the event is executed (S107). 
If there is no event, it is determined whether a counter 
g Check Time = 0 (S102). If it is determined (S102) 
that the counter g Check Time = 0, the states of con- 
nected devices are checked (S103), and device IDs 
are assigned to the multimedia devices described on 
a created state-of-connection management table 

(5104) . The device IDs correspond to the IP address- 
es used in a TCP/IP protocol, and are so-called logical 
addresses relative to individual multimedia devices. 
By assigning the devices IDs to the respective multi- 
media devices, the multimedia controller 1 and each 
of the multimedia devices can communicate with 
each other without being conscious of physical ad- 
dresses. 

If a new device is connected to the multimedia 
control system or a connected device is disconnected 
from the multimedia control system, the device IDs 
are automatically reassigned so that sending and re- 
ceiving addresses can be unitarily managed. The 
multimedia controller 1 rewrites a display of the states 
of the connected devices while referring to the thus- 
created state-of-connection management table 

(5105) , and sets the value of the counter g Check 
Time to a preset value (S1 06). Fig. 55 shows the con- 
struction of the aforesaid state-of-connection man- 
agement table. 

On the table shown in Fig. 55, numbers unique to 



the respective multimedia devices are stored in the 
column named "UNIQUE NUMBER", and are also 
used as physical addresses. The unique numbers 
contains attribute information, such as digital VTR or 

5 CD player, about the respective multimedia devices. 
If a plurality of multimedia devices having identical at- 
tribute information are connected to the multimedia 
control system, different names are assigned to the 
respective multimedia devices and are stored in the 

10 column "DEVICE NAME" on the state-of-connection 
management table shown in Fig. 55. For example, in 
the case of Fig. 55, since two digital VTRs are con- 
nected, Digital VTR1 and Digital VTR2 are stored as 
the respective device names. The column "OBJECT 

15 INFORMATION STORAGE ADDRESS" shown in Fig. 
55 stores object information, such as pointers to 
areas in which display and manipulation objects for 
the respective multimedia devices are stored. The 
column "OBJECT INFORMATION STORAGE AD- 

20 DRESS" will be described later in detail. The column 
"DEVICE ID" shown in Fig. 55 stores the aforemen- 
tioned device IDs. The other columns "POWER 
ON/OFF" and "CONFIRMATION OF CONNECTION" 
will also be described later. 

25 Processing to be executed to check the states of 

the connected devices (S103) will be described below 
in detail. Fig. 56 is a flowchart of the aforementioned 
state-of-connected device check. First of all, a vari- 
able Wait Timer which performs a counting operation 

30 to determine whether a communication time has 
reached a time-out value is initialized (S107), and a 
state-of-connected-device request message is sent 
from the multimedia controller 1 to each of the multi- 
media devices (S108). Then, the variable Wait Timer 

35 is incremented (S109), and it is determined whether 
the value of the variable Wait Timer exceeds a time- 
out value Li mit (S11 0). If the value of the variable Wait 
Timer does not exceed the time-out value Limit, it is 
determined whether an acknowledgment message 

40 has been received from each of the multimedia devic- 
es (S111). If no acknowledgment message has yet 
been received, the processteturns to step S1 09. If an 
acknowledgment message has been received, it is 
checked whether a multimedia device which has sent 

45 the acknowledgment message is already stored on 
the state-of-connection management table (S112). If 
this multimedia device is one of the multimedia devic- 
es stored on the state-of-connection management ta- 
ble, a confirmed check mark is recorded in a corre- 

50 sponding part of the column "CONNECTION CON- 
FIRMATION" on the state-of-connection manage- 
ment table (S115). If the aforesaid multimedia device 
is a multimedia device which is not stored on the 
state-of-connection management table, the multime- 

55 dia device is registered on the state-of-connection 
management table, and a confirmed checkmark is re- 
corded in a corresponding part of the column "CON- 
NECTION CONFIRMATION" (S114). 
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Then, the variable Wait Timer is initialized (S116), 
and the process returns to Step S109 t in which the 
process waits for an acknowledgment message to be 
sent from another of the multimedia devices. If it is de- 
termined in Step S110 that the value of the variable 
Wait Timer exceeds the time-out value Limit, it is de- 
termined whether the multimedia devices stored on 
the state-of-connection management table contain a 
multimedia device for which no confirmed checkmark 
is recorded in the column "CONNECTION CONFIR- 
MATION" (S117). If there is no such multimedia de- 
vice, the process is brought to an end. 

If it is determined that there is a multimedia de- 
vice for which no confirmed check mark is recorded 
in the column "CONNECTION CONFIRMATION", the 
variable Wait Timer is initialized (S118) and a state- 
of-connected-device request message is again sent 
to the multimedia device for which no confirmed 
check mark is recorded in the column "CONNECTION 
CONFIRMATION" (S119). Then, the variable Wait 
Timer is incremented (S120), and it is determined 
whether the value of the variable Wait Timer exceeds 
the time-out value Limit (S121). 

If it is determined in Step S121 that the value of 
the variable Wait Timer exceeds the time-out value 
Limit, it is determined that the multimedia device is 
not connected, and the multimedia device is erased 
from the state-of-connection management table 
(S125). If it is determined in Step S121 that the value 
of the variable Wait Timer does not exceed, it is 
checked whether an acknowledgment message has 
been received from the multimedia device (S122). If 
no acknowledgment message has yet been received, 
the process returns to Step S120, in which the proc- 
ess waits for an acknowledgment message to be sent 
from the multimedia device until it is determined in 
Step S121 that the value of the variable Wait Timer 
exceeds the time-out value Limit. 

If it is determined in Step S122 that the acknowl- 
edgment message has been received, it is deter- 
mined whether the multimedia device which has is- 
sued the acknowledgment message coincides with 
an expected multimedia device (S123). If they coin- 
cide with each other, a confirmed check mark is re- 
corded in the column CONNECTION CONFIRMA- 
TION" on the state-of-connection management table 
(S1 24). If they do not coincide with each other, it is de- 
termined that an abnormality has occurred, and the 
multimedia device is erased from the state-of- 
connection management table and a warning opera- 
tion is executed (S125). Then, the process returns to 
Step S117. The above processing is repeated until 
confirmed check marks for all the multimedia devices 
are recorded in the column "CONNECTION CONFIR- 
MATION". By executing this series of steps (S107 to 
S125) at regular intervals, the state-of-connection 
management table is updated and the multimedia de- 
vices connected to the multimedia control system can 



be correctly grasped. 

Figs. 57(a) to 57(d) represent means for present- 
ing the multimedia devices which have had their con- 
nections confirmed in the above-described manner to 
5 the user of the multimedia controller 1 . Fig. 57(a) is a 
view showing a state in which a connected-device 
confirmation panel 126 is displayed on a display de- 
vice 125 of the multimedia controller 1 in response to 
a connected-device confirmation display command 
10 executed by the user. A particular application panel 
127 is also shown which had been displayed before 
the connected-device confirmation display command 
was executed by the user. 

Icons 128, 129, 130, 131, 132 and 133 represen- 
ts tative of the respective multimedia devices which 
have had their connections confirmed are displayed 
on the connected-device confirmation panel 126. 

The icons of the multimedia devices whose sub- 
sidiary power sources are on are displayed in inverted 
20 or outlined form to inform the user that the power 
source circuits of the multimedia devices are on. In 
the example shown in Fig. 57(a), the icon 130 indi- 
cates that the subsidiary power source of the corre- 
sponding multimedia device (digital vTR) is off. 
25 If the icon 130 of the multimedia device is clicked 

by a cursor 134 manipulated by a pointing device (not 
shown) such as a mouse, a manipulation panel 135 
for the multimedia device indicated by the icon 130 is 
displayed as shown in Fig. 57(b). The multimedia de- 
30 vice can be manipulated by manipulating a desired 
one of the switches displayed on the manipulation 
panel 135 by using the cursor 134. In the example 
shown in Fig. 57(b), a power on/off button is clicked 
to turn on the subsidiary power source. Fig. 57(c) 
35 shows a state in which the state shown in Fig. 57(b) 
is reflected on the connected-device confirmation 
panel 126. 

Figs. 58 to 62 are flowcharts showing the opera- 
tion of the aforementioned power on/off manipulation. 
40 Fig. 58 shows the operation of the multimedia control- 
ler, while Fig. 59 shows the operation of the multime- 
dia device. If the user performs the manipulation of 
turning on a subsidiary power source, the multimedia 
controller sends a power-on message to a multimedia 
device to be manipulated (S 1 26). A counter Cmd Wait 
Counter, which counts elapsed time up to a time-out 
value for the purpose of allowing the multimedia con- 
troller to wait for arrival of an acknowledgment mes- 
sage, is reset (S127), and the multimedia controller 
waits for an acknowledgment message. The multime- 
dia device to be manipulated receives the power-on 
message and executes a power-on operation (S134), 
and it is determined whether the power source of the 
multimedia device has been normally operated 
(S135). If the power source has been normally oper- 
ated, the multimedia device sends a normal comple- 
tion message to the multimedia controller (S136). If 
there is an abnormality, the multimedia device sends 
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an abnormal end message to the multimedia control- 
ler (S137). If the multimedia controller receives the 
acknowledgment message and determines that there 
is an acknowledgment (S128), then it is determined 
whether the power-on operation has been normally 
completed (S131). If the power-on operation has 
been normally completed, the multimedia controller 
records a power-on check mark in a corresponding 
part of the column "POWER ON/OFF" of the state-of- 
connection management table (S133). If there is an 
abnormality, the multimedia controller sends an error 
message to the multimedia device (S132). If it is de- 
termined in Step S128 that there is no acknowledg- 
ment, the multimedia controller determines whether 
the value of the counter Cmd Wait Counter exceeds 
the time-out value Limit. If it is determined that the 
value of the counter Cmd Wait Counter exceeds the 
time-out value Limit, the process proceeds to Step 
S1 32 mentioned above. If it is determined that the val- 
ue of the counter Cmd Wait Counter does not exceed 
the time-out value Limit, the counter Cmd Wait Coun- 
ter is incremented (S130) and the process returns to 
Step S128. 

It is also possible to automatically execute the 
power on/off operation. Figs. 60, 61 and 62 are flow- 
charts showing processing for automatically execut- 
ing the power on/off operation. Fig. 60 shows the op- 
eration of the multimedia controller, while Fig. 61 
shows the power-on operation of each of the multime- 
dia devices. Fig. 62 shows an automatic power-off op- 
eration to be executed by each of the multimedia de- 
vices. 

First of all, an operation request message is sent 
from the multimedia controller to a particular one of 
the multimedia devices (S190). The particular multi- 
media device receives the operation request mes- 
sage and determines whether its own subsidiary 
power source is on at that time (S199). If the subsidi- 
ary power source is off, the multimedia device exe- 
cutes a power-on operation (S500) and confirms 
whether the power source has been normally turned 
on(S501). 

If the power source has been normally turned on, 
or if it is determined in Step S199 that the power 
source has already been turned on, the multimedia 
device executes the operation requested by the mul- 
timedia controller (S502) and confirms whether the 
operation has been normally completed (S503). If it is 
determined that the operation has been normally 
completed, the multimedia device sends a normal 
completion message to the multimedia controller. If 
an abnormality has occurred, or if it is determined in 
Step S501 that the power source has not been nor- 
mally turned on, the multimedia device turns off the 
subsidiary power source (S505) and sends an abnor- 
mal end message to the multimedia controller (S506). 

In the meantime', after the multimedia controller 
has sent the operation request message to the par- 



ticular multimedia device in Step S190, the multime- 
dia controller is placed in the state of waiting for an 
acknowledgment message from the particular multi- 
media device. 

5 First of all, the multimedia controller clears the 

counter Cmd Wait Counter which counts elapsed time 
up to the time-out value for the purpose of allowing 
the multimedia controller to wait for arrival of an ac- 
knowledgment message (S191) and checks whether 

10 there is an acknowledgment (S1 92). If there is not an 
acknowledgment, the multimedia controller determi- 
nes whether the value of the counter Cmd Wait Coun- 
ter exceeds the time-out value Limit (S1 93). If it is de- 
termined that the value of the timer Cmd Wait Counter 

15 does not exceed the time-out value Limit, the counter 
Cmd Wait Counter is incremented (S194) and the 
process returns to Step S192 to wait for an acknowl- 
edgment message. 

If it is determined in Step S1 92 that there is an ac- 

20 knowledgment message, it is confirmed whether the 
acknowledgment message is a normal completion 
message (S195). If the acknowledgment message is 
a normal completion message, the multimedia device 
records a power-on check mark in the column "POW- 

25 ER ON/OFF" of a corresponding multimedia device 
on the state-of-connection management table 
(S197). 

If it is determined in Step S195 that the acknowl- 
edgment message is an abnormal end message, and 

30 if it is determined in Step S193 that the value of the 
counter Cmd Wait Counter exceeds the time-out val- 
ue Limit, the multimedia controller sends an error 
message to the user (S1 97) and records a power-off 
check mark in the column "POWER ON/OFF" of a cor- 

35 responding multimedia device on the state-of- 
connection management table (S198). 

The automatic power-off operation of each of the 
multimedia devices is executed in the following man- 
ner. First of all, the multimedia device confirms 

40 whether an event has occurred (S507), and if an 
event has occurred, the multimedia device executes 
the processing of the event (S513). Then, the multi- 
media device presets a counter Power Down Counter 
for measuring the time which elapses until the auto- 

45 matic power-off operation is executed (S514), and 
the value of a flag Power Down Enable Flag for indi- 
cating whether the value of the counter Power Down 
Counter is valid is made true (S515). The counter 
Power Down Counter is a counter which is decre- 

so mented by a software or hardware timer, and the flag 
Power Down Enable Flag indicates whether the value 
of the counter Power Down Counter is valid. Only 
when the value of this flag is true, the multimedia de- 
vice is allowed to execute the automatic power-off op- 

55 eration while referring to the counter Power Down 
Counter. 

If it is determined in Step S507 that there is no 
event, the multimedia device checks whether the val- 

27 
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ue of the flag Power Down Enable Flag is true (S508). 
If it is true, the multimedia device checks the value of 
the counter Power Down Counter (S509). If the value 
is zero, the multimedia device executes the operation 
of turning off the subsidiary power source (S510) and 5 
sends a power-off message to the multimedia con- 
troller (S511). Then, the multimedia device makes 
false the value of the flag Power Down Enable Flag, 
and waits for the next event (S512). 

If it is determined in Step S508 that the value of 10 
the flag Power Down Enable Flag is false, or if it is de- 
termined in Step S509 that the value of the counter 
Power Down Counter is not zero, the multimedia de- 
vice waits for the next event. The multimedia control- 
ler receives the power-off message and records a 15 
power-off check mark in the column "POWER 
ON/OFF" of a corresponding multimedia device on 
the state-of-connection management table. 

By automatically controlling the on/off operation 
of the subsidiary power source in the above- 20 
described manner, it is possible to supply electrical 
power to a required multimedia device at only a re- 
quired time, so that power consumption can be sup- 
pressed. 

Although the user requests the connected-de- 25 
vice confirmation panel 126 in the example shown in 
Fig. 57(a), it is also possible to adopt the example 
shown in Fig. 57(d) in which the icons of the multime- 
dia devices which have had their connections con- 
firmed are at all times displayed on the display device 30 
125. In the example shown in Fig. 57(d), if a particular 
multimedia device is disconnected, the icon of the 
multimedia device is erased, so that the connected 
multimedia devices can be displayed in real time. 

Fig. 63 is a block diagram showing the construe- 35 
tion of a fifth embodiment of the present invention. As 
can be seen from Fig. 63, although the fifth embodi- 
ment of the present invention is basically identical in 
construction to the fourth embodiment of the present 
invention, the fifth embodiment is characterized in 40 
that the respective multimedia devices 102-1, 102-2 
and 102-3 include timer circuits 1 (136-1, 136-2 and 
1 36-3). Further, the fifth embodiment is identical to 
the fourth embodiment in that the multimedia control- 
ler 1 confirms the status of each connected multime- 45 
dia device at regular intervals, but the fourth and fifth 
embodiments differ from each other in the following 
respect. In the fourth embodiment, the period of each 
of the regular intervals is managed by the timer circuit 
included in the multimedia controller 1, whereas, in 50 
the fifth embodiment, such period is managed by the 
timer circuits 1 (136-1, 136-2 and 136-3) provided in 
the respective multimedia devices. 

The state-of-connection management table used 
in the fifth embodiment differs from that used in the 55 
fourth embodiment shown in Fig. 64 in that the table 
used in the fifth embodiment includes a column for a 
presence confirmation counter. The presence confir- 
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mation counter is provided for each multimedia de- 
vice registered on the table, and the presence confir- 
mation counter performs its counting operation in ac- 
cordance with a timer circuit 2 included in the multi- 
media controller 1. In the fifth embodiment of the 
present invention, each multimedia device demon- 
strates its own presence by sending a state-of- 
device-connection information message to the multi- 
media controller 1, and when the multimedia control- 
ler 1 receives the state-of-device-connection informa- 
tion message, the multimedia controller 1 resets the 
presence confirmation counter. 

As described above, each of the presence confir- 
mation counters always performs its counting opera- 
tion in accordance with the timer circuit 2. If a partic- 
ular multimedia device does not send out the state-of- 
device-connection information message, the pres- 
ence confirmation counter is incremented up to a par- 
ticular threshold and at the time when the value of the 
presence confirmation counter exceeds the particu- 
lar threshold, it is determined that the particular mul- 
timedia device is not connected or is in an abnormal 
state. 

Fig. 65 is a flowchart showing the processing of 
an event loop of the multimedia controller 1 , while Fig. 
66 is a flowchart showing an event loop of each of the 
multimedia devices. A connection confirmation oper- 
ation of the fifth embodiment of the present invention 
will be described below with reference to Figs 65 and 
66. 

First of all, each of the multimedia devices deter- 
mines whether there is an event caused by the ma- 
nipulation of the manipulation panel of each of the 
multimedia devices by a user or an event sent from 
the multimedia controller through communication 

(5148) . If there is either event, each of the multimedia 
devices executes processing according to the event 

(5149) . If there is no event, each of the multimedia de- 
vices determines whether a counter f Refresh Coun- 
ter = 0 (S150). The counter f Refresh Counter is a 
counter which manages the period during which each 
of the multimedia devices sends its state-of-device- 
connection information message to the multimedia 
controller, and performs its counting operation in ac- 
cordance with each of the timer circuits 136-1, 136-2 
and 136-3. If it is determined in Step S150 that the 
counter f Refresh Counter = 0, each of the multimedia 
devices sends the state-of-device-connection infor- 
mation message to the multimedia controller (S1 51), 
and resets the counter f Refresh Counter. Then, the 
process returns to Step S148, and waits for the next 
event. 

In the meantime, the multimedia controller deter- 
mines whether there is an event caused by the ma- 
nipulation of the manipulation panel of the multimedia 
controller by the user or an event sent from each of 
the multimedia devices through communication 
(S138). If there is either event, the multimedia con- 
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troller determines whether the event is the state-of- 
device-connection information message sent from 
any of the multimedia devices (S141). If there is an- 
other event, the multimedia controller executes proc- 
essing according to the event (S143). If it is deter- 
mined that the aforesaid event is the state-of-device- 
connection information message, the multimedia 
controller checks whether the multimedia device 
which has sent the message is already stored on a 
state-of-connection management table (S142). If the 
multimedia device is not stored on the state-of- 
connection management table, the multimedia con- 
troller newly stores the multimedia device on the 
state-of-connection management table (S145), and 
clears to zero a counter g Refresh Counter_X of the 
corresponding multimedia device. If it is determined 
in Step S142 that the multimedia device is already 
stored on the state-of-connection management table, 
the multimedia controller clears to zero the presence 
confirmation counter g Refresh Counter_X of the mul- 
timedia device. 

The multimedia controller provides display of 
connected devices on the basis of the thus-updated 
state-of-connection management table (S147), and 
the process returns to Step S138 to wait for the next 
event. If it is determined in Step S138 that there is no 
event, the multimedia controller confirms the values 
of the presence confirmation counter g Refresh 
Counter_X of each of the multimedia devices (S139). 
If the counter g Refresh Counter_X of a particular one 
of the multimedia devices exceeds the threshold Lim- 
it, the multimedia controller erases the multimedia 
device from the state-of-connection management ta- 
ble (S140) and provides display of connected devices 
on the basts of the updated state-of-connection man- 
agement table (S147). 

Regarding operations associated with a power 
on/off operation and the icon displays of the multime- 
dia devices which have had their connections con- 
firmed, it is possible to realize means and effects sim- 
ilar to those described previously in connection with 
the fourth embodiment of the present invention. 

A sixth embodiment of the present invention will 
be described below. 

Fig. 67 is a block diagram showing the construc- 
tion of the sixth embodiment of the present invention. 
As can be seen from Fig. 67, the sixth embodiment 
of the present invention is basically identical in con- 
struction to the fourth embodiment of the present in- 
vention, but the timer circuit 105 provided in the mul- 
timedia controller 1 according to the fourth embodi- 
ment is not employed and a relay 137 is provided in 
the physical connection between the multimedia con- 
troller and each of the multimedia devices. The relay 
137 includes a network line connection terminal to 
which to connect at least one multimedia device, line 
connection detecting circuits (138-1, 138-2 and 138- 
3) which correspond to individual line connection ter- 



minals on a one-to-one basis, an interface controller 
1 07-4 which is similar to that of the multimedia con- 
troller or each of the multimedia devices, a power 
source circuit 108-4, and a control device 139 for con- 

5 trolling the above-noted elements. Each of the line 
connection detecting circuits 138-1, 138-2 and 138- 
3 observes the state of a line, for example the traffic 
volume of a communication, to detect whether a com- 
municable device is connected to a corresponding 

10 communication line. 

The sixth embodiment of the present invention 
differs from either of the fourth and fifth embodi- 
ments in that the states of the respective multimedia 
devices connected to the system are not checked at 

is particular periodic intervals. The sixth embodiment is 
characterized in that when a multimedia device is 
newly connected to the system or when a connected 
multimedia device is disconnected from the system, 
a message to that effect is transmitted to the multi- 

20 media controller from the relay to which the multime- 
dia devices are connected, so that the multimedia 
controller can recognize the multimedia devices con- 
nected to the system. The state-of-connection man- 
agement table used in the sixth embodiment of the 

25 present invention is similar to the table of Fig. 55 de- 
scribed previously in connection with the fourth em- 
bodiment of the present invention. 

The operation of the sixth embodiment of the 
present invention will be described below. Fig. 69 is 

30 a flowchart showing the processing of an event loop 
of the multimedia controller 1, Fig. 70 is a flowchart 
showing the processing in which the relay sends a 
multimedia-device connection confirmation message 
to the multimedia controller, and Fig. 71 is a flowchart 

35 showing the processing in which the relay sends a 
multimedia device disconnection message to the 
multimedia controller. 

The operation of the relay will be described below 
with reference to the flowchart of Fig. 70. The relay 

40 checks the outputs of the respective line connection 
detecting circuits 138-1, 138-2 and 138-3, the num- 
ber of which corresponds to the number of ports of the 
relay on a one-to-one basis (S153), and detects 
whether the multimedia devices have been connect- 

45 ed to the respective ports (S154). If it is determined 
that the multimedia devices have been connected, 
the relay transmits to the multimedia controller a 
message indicating that they have been connected 

(5 1 55) , and clears a counter Ack Counter for perform- 
so ing a counting operation to wait for an acknowledg- 
ment to be transmitted from the multimedia controller 

(5156) . Then, it is determined that an acknowledg- 
ment Ack has been transmitted from the multimedia 
controller (S157), and if no acknowledgment has yet 

55 been transmitted, the relay increments the counter 
Ack Counter (S158) and determines whether the val- 
ue of the counter Ack Counter does not exceed the 
time-outvalue Limit (S1 59). If it is determined that the 
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value of the counter Ack Counter does not exceed the . 
time-out value Limit, the process returns to Step . 
S157, in which the relay waits for an acknowledgment 
from the multimedia controller. If it is determined in 
Step S1 59 that the value of the counter Ack Counter 
exceeds the time-out value Limit, the relay informs 
the user of the occurrence of an error (S160). If it is 
confirmed in Step S157 that an acknowledgment 
from the multimedia controller has normally been re- 
ceived, the relay performs normal-connection confir- w 
mation processing (S161) and completes the connec- 
tion confirmation processing. 

The operation of the relay when a particular mul- 
timedia device is disconnected from the relay will be 
described below with reference to Fig. 71. 15 

The relay checks the outputs o{ the line connec- 
tion detecting circuits, the number of which corre- 
sponds to the number of ports on a one-to-one basis 
(S188), and detects whether any of the multimedia 
devices connected to the respective ports has been 20 
disconnected (S189). If it is determined that a partic- 
ular multimedia device has been disconnected, the 
relay transmits a message indicative of the discon- 
nection to the multimedia controller (S190), in which 
the relay brings the processing to an end. 25 

The processing of the multimedia controller will 
be described below with reference to Fig. 69. First of 
all, it is determined whether there is an event sent 
from the user or through communication (S162). If 
there is an event, it is determined whether the event 30 
is the aforesaid device disconnection message 
(S163). If it is determined that the event is the device 
disconnection message, the multimedia controller 
clears a counter Retry Counter (S1 69) and clears the 
counter Ack Counter (S170). A message identical to 35 
the state-of-device-connection information message 
used in the fourth embodiment is transmitted to the 
multimedia device which appears to have been dis- 
connected (S171). The counter Ack Counter serves 
as a timer for measuring the time-out period during 40 
which an acknowledgment of the state-of-device- 
connection information message is sent from the cor- 
responding multimedia device to the multimedia con- 
troller. The counter Retry Counter serves as a coun- 
ter for counting the number of times of retries to be 45 
executed if an acknowledgment is not transmitted 
within the time-out period. The multimedia controller 
waits for an acknowledgment of the state-of-device- 
connection information message (S172). If the ac- 
knowledgment has been received, the multimedia so 
controller determines that the corresponding multi- 
media device is still connected, and waits for the next 
event. If the acknowledgment has not been received, 
the multimedia controller increments the counter Ack 
Counter (S 1 73) and determines whether the value of 55 
the counter Ack Counter exceeds the time-out period 
(S174). If the value of the counter Ack Counter does 
not exceed the time-out period, the process returns 

30 



to Step S1 72 to wait for an acknowledgment If the val- 
ue of the counter Ack Counter exceeds the time-out 
period, the multimedia controller increments the 
counter Retry Counter (S1 75) and determines wheth- 
er the value of the counter Retry Counter does not ex- 
ceed the predetermined number of times of retries 
(S176). If it is determined that the value of the counter 
Retry Counter does not exceed the predetermined 
number of times of retries, the process returns to the 
processing of Step S170, in which the multimedia 
controller again issues a state-of-device-connection 
information message. 

If the value of the counter Retry Counter exceeds 
the predetermined number of times of retries, it is de- 
termined that no acknowledgment has been transmit- 
ted from the corresponding multimedia device, i.e., 
the multimedia device has been disconnected.' The 
multimedia controller erases information about the 
multimedia device from the state-of-connection man- 
agement table (S177), thereby updating the state-of- 
connection management table. 

If it is determined in Step S163 that the event is 
not the device disconnection message, it is deter- 
mined whether the event is the device connection 
message (S164). If it is determined that the event is 
the device connection message, it is confirmed 
whether the corresponding multimedia device is a de- 
vice already stored on the state-of-connection man- 
agement table (S165). If the multimedia device is an 
already stored device, the multimedia controller does 
not rewrite the state-of-connection management ta- 
ble. If it is determined that the multimedia device is a 
multimedia device which has not yet been stored on 
the state-of-connection management table, the mul- 
timedia controller newly registers the multimedia de- 
vice on the state-of-connection management table, 
thereby updating the state-of-connection manage- 
ment table. 

The multimedia controller reassign the device 
IDs by using the state-of-connection management ta- 
ble updated in the above-described manner (S178), 
and displays the states of the respective connected 
devices as the corresponding multimedia-device 
icons (S179). 

Regarding operations associated with a power 
on/off operation and the icon displays of the multime- 
dia devices which have had their connections con- 
firmed, it is possible to realize means and effects sim- 
ilar to those described previously in connection with 
the fourth embodiment of the present invention. 

A seventh embodiment of the present invention 
will be described below. Fig. 68 is a block diagram 
showing the construction of the seventh embodiment 
of the present invention. As can be seen from Fig. 68, 
the sixth embodiment of the present invention is ba- 
sically identical to the fourth embodiment of the pres- 
ent invention, but the timer circuit 1 05 provided in the 
multimedia controller 1 according to the fourth em- 
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bodiment is not employed. Each of the multimedia de- 
vices includes at least two line connection terminals 
and line connection detecting circuits (183-4, 183-5), 
(183-6, 183-7) and (183-8, 183-9) which correspond 
to the respective line connection terminals on a one- 
to-one basis. Each of the multimedia devices is chain- 
connected to the line connection detecting circuits as 
shown in Fig. 68, i.e., the relay used in the sixth em- 
bodiment shown in Fig. 67 is contained in each of the 
multimedia devices. The operation of the seventh em- 
bodiment will be described below. 

Referring to Fig. 68, for example, if the multime- 
dia device C is newly connected to the multimedia de- 
vice B, the multimedia device B serves the function 
of the relay described above in connection with the 
sixth embodiment of the present invention. When the 
line connection detecting circuit 183-7 of the multime- 
dia device B detects that the multimedia device C has 
been connected to the multimedia device B, the line 
connection detecting circuit 183-7 transmits a device 
connection message to the multimedia controller 1. 

If the multimedia device C is disconnected from 
the multimedia device B, the multimedia device B 
similarly serves the function of the relay described 
above in connection with the sixth embodiment of the 
present invention. When the line connection detect- 
ing circuit 183-7 of the multimedia device B detects 
that the multimedia device C has been disconnected 
from the multimedia device B, the line connection de- 
tecting circuit 1 83-7 transmits a device disconnection 
message to the multimedia controller 1. 

Similarly to the case of the sixth embodiment of 
the present invention, the flow shown in Fig. 70 is 
used for processing to be executed during the trans- 
mission of the device connection message by the 
multimedia device B, the flow shown in Fig. 71 is used 
for processing to be executed during the transmission 
of the device disconnection message by the multime- 
dia device B, and the flow shown in Fig. 69 is used for 
processing to be executed by the multimedia control- 
ler 1. 

An eighth embodiment of the present invention 
will be described below. The construction of the 
eighth embodiment is shown in Fig. 74. As can be 
seen from Fig. 74, the eighth embodiment of the pres- 
ent invention is basically identical in construction to 
the fourth embodiment, but the timer circuit 105 pro- 
vided in the multimedia controller 1 according to the 
fourth embodiment is not used. The eighth embodi- 
ment is characterized in that the respective multime- 
dia devices includes line connection detecting circuits 
138-10, 138-11 and 138-12 as well as cable connec- 
tors which serve as cable unlocking/cable disconnec- 
tion detecting switches. The line connection detecting 
circuits 138-10, 138-11 and 138-12 are similar to 
those described previously in connection with each of 
the sixth and seventh embodiments of the present in- 
vention. One of the cable connectors which serve as 
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cable unlocking/cable disconnection detecting 
switches is shown in Fig, 75. As shown in Fig. 75, 
when a line cable 112 is connected to a connector 
143, the line cable 112 is locked by a lock mechanism 
5 so that accidental removal of the line cable 112 can 
be prevented. To remove the line cable 112, a cable 
unlocking/cable disconnection detecting switch 142 is 
pressed to release a cable lock. At this time, before 
the line cable 112 is removed, a cable disconnection 
10 detection signal is transmitted to a corresponding one 
of the line connection detecting circuits 138-10, 138- 
11 and 138-12 so that the line cable 112 is about to 
be removed. 

The line connection detecting circuit which has 
15 received the cable disconnection detection signal a 
device disconnection message to the multimedia de- 
vice 1 similarly to the case of each of the sixth and 
seventh embodiments of the present invention. If an- 
other line cable is inserted to add a new multimedia 
20 device to the system, a corresponding line connection 
detecting circuit detects the connection of the line 
cable to transmit a device connection message to the 
multimedia controller 1. 

Referring to Fig. 74, for example, if the multime- 
25 dia device C is newly connected to the multimedia de- 
vice B, a line connection detecting circuit 183-12 of 1 
the multimedia device C detects that the multimedia 
device C has been connected to the communication 
line 112, the line connection detecting circuit 183-12 
30 transmits a device connection message to the multi- 
media controller 1. 

In Fig. 74, if the multimedia device C is to be dis- 
connected from the multimedia device B, the line cable 
112 is removed by pressing the cable unlocking/cable 
35 disconnection detecting switch of the multimedia de- 
vice C and releasing the cable lock. Accordingly, be- 
fore the line cable 1 1 2 is removed, a cable disconnec- 
tion detection signal is transmitted to the line connec- 
tion detecting circuit 138-12. The line connection de- 
40 tecting circuit 138-12 transmits a device disconnec- 
tion message to the multimedia controller 1. 

In the above-described manner, the connected 
devices are confirmed to create the state-of- 
connection management table, thereby managing 
45 each of the multimedia devices. 

Similarly to the case of each of the sixth, seventh 
and eighth embodiments of the present invention, the 
flow shown in Fig. 71 is used for the processing of 
transmitting the device disconnection message, the 
so flow shown in Fig. 70 is used for the processing of 
transmitting the device connection message, and the 
operation of the multimedia device 1 is shown in the 
flowchart of Fig. 69. 

A ninth embodiment of the present invention will 
55 be described below. The ninth embodiment of the 
present invention is characterized in that each multi- 
media device includes an identification name display 
part 141 as shown in Fig. 72. In accordance with the 
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ninth embodiment, the aforesaid state-of-connection 
management table for managing individual multime- 
dia devices connected to the system is created by any 
of the techniques according to the fourth, fifth, sixth, 
seventh and eighth embodiments of the present in- 
vention, and, as described previously in connection 
with the fourth embodiment, at the time when a newly 
connected or disconnected device is recognized, 
unique identification names which correspond to the 
respective multimedia devices on a one-to-one basis 
are assigned to them. Further, in accordance with the 
ninth embodiment, the unique identification names 
are transmitted to the respective multimedia devices 
and displayed on the .identification name display 
parts provided on the respective multimedia devices. 

The operation of the ninth embodiment of the 
present invention will be described below with refer- 
ence to the construction of Fig. 52 described previ- 
ously in connection with the fourth embodiment of the 
present invention. 

Fig. 73 is a flowchart showing the processing of 
a main event loop of the multimedia controller 1 . First 
of all, it is determined whether there is an event 
caused by the manipulation of the multimedia control- 
ler 1 by a user who is manipulating the multimedia 
controller 1 or an event sent from any of the multime- 
dia devices through communication (S1 80). If there is 
either event, the processing of the event is executed 
(S182). If there is no event, it is determined whether 
the counter g Check Time = 0 (S181). The counter g 
Check Time is a counter which manages the period 
during which the multimedia controller executes a 
series of state- of- connected device checking opera- 
tions, and performs a counting operation in accor- 
dance with the timer circuit 105. If it is determined 
(S181) that the counter g Check Time = 0, the states 
of connected devices are checked (S183), and device 
IDs are assigned to the multimedia devices described 
on a created state-of-connection management table 
(S184). 

The multimedia controller rewrites a display of 
the states of the connected devices while referring to 
the thus-created state-of-connection management 
table (S185), and sets the value of the counter g 
Check Time to a preset value (S186). The multimedia 
controller also transmits the identification names 
stored in the column "DEVICE NAME" on the state-of- 
connection management table shown in Fig. 55 to the 
respective multimedia devices (S187). For example, 
in the case of Fig. 55, since two digital VTRs are con- 
nected and Digital VTR1 and Digital VTR2 are stored 
in the column "DEVICE NAME", the device nemas are 
transmitted to the respective digital VTRs and dis- 
played on the identification name display parts there- 
of. 

Although the above description has been made 
with reference to the construction of the fourth em- 
bodiment, the ninth embodiment is applicable to any 
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of the fifth, sixth, seventh and eighth embodiments of 
the present invention. 

As is apparent from the above description, with 
the arrangement according to any of the above- 

5 described embodiments, a user can correctly grasp 
the multimedia devices connected to the system with- 
out being particularly conscious of them. Also, if a 
multimedia device is newly connected to or discon- 
nected from the system, the user does not need to 

w perform a troublesome operation and can perform a 
device recognizing operation with the system being 
activated. 

Also, since it is possible to unitarily perform the 
management and manipulation of the power source of 
15 each of the multimedia devices, it is possible to effi- 
ciently turn on and off the power source, whereby it 
is possible to efficiently operate the system. 

Further, since the identification names identified 
by the multimedia controller are displayed on the 
20 identification name display parts of the respective 
multimedia devices, the user can easily visually de- 
termine a multimedia device desired to be used. Ac- 
cordingly, it is possible to construct a system for mul- 
timedia devices which can be easily accepted by 
25 even common users having no special knowledge or 
skill about computer systems. 

The applicants reserve the right to claim any of 
the features particularly disclosed above, both as 
part of and independently of the object-oriented mul- 
30 timedia control system as a whole. 



Claims 

35 1. A control system comprising: 

a plurality of peripheral devices represent- 
ed as objects; and 

a controller connectable to said plurality of 
peripheral devices via a common communication 
40 line for unitarily controlling said plurality of per- 

ipheral devices, 

said controller being arranged to be con- 
nected to an arbitrary number of peripheral devic- 
es selected from among said plurality of periph- 
45 eral devices, read control information stored in 

the arbitrary number of peripheral devices via the 
communication line into a predetermined mem- 
ory area of said controller in a predetermined for- 
mat so that said controller can control said arbi- 
50 trary number of peripheral devices, 

said controller being also arranged to is- 
sue a command and transmit the command to 
each of the arbitrary number of peripheral devic- 
es via the communication line. 

55 

2. A control system according to claim 1, wherein 
said plurality of peripheral devices represented 
as the objects and said controller each include 
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message communicating means for communicat- 
ing a message indicative of a control instruction, 
a data input/output instruction or the like be- 
tween each of said plurality of peripheral devices 
and said controller. 

3. A control system, according to claim 2, wherein 
said plurality of peripheral devices represented 
as the objects and said controller each include 
methods containing execution procedures, func- 
tions, subroutines and the like each of which is to 
be specified by the message, as well as an en- 
vironment for executing each of the methods. 

4. A control system according to claim 3, wherein 
said plurality of peripheral devices represented 
as the objects and said controller are each en- 
capsulated in such a manner as to hide internal 
data indicative of an internal state, a variable 
parameter and the like in its inside and also to call 
a method to indirectly access the internal data. 

5. A control system according to claim 4, wherein 
each of said plurality of peripheral devices repre- 
sented as the objects holds a manipulation panel, 
a display device and the like as a graphical user 
interface (GUI) in such a manner as to be able to 
be manipulated or provide display by means of 
said controller located externally of each of said 
plurality of peripheral devices, each of said plur- 
ality of peripheral devices including means for 
sending out the graphical user interface to said 
controller. 

6. A control system according to claim 5, wherein 
each of said plurality of peripheral devices repre- 
sented as the objects includes a method defini- 
tion table which defines a method corresponding 
to an operation of the manipulation panel held as 
the graphical user interface (GUI), and means for 
sending out the method definition table to said 
controller. 

7. A control system according to claim 6 ( wherein 
each of said plurality of peripheral devices repre- 
sented as the objects realizes both the graphical 
user interface (GUI) and the method definition ta- 
ble as a GUI object, each of said plurality of per- 
ipheral devices including means for sending out 
the GUI object to said controller. 

8. A control system according to claim 6, wherein 
each of said plurality of peripheral devices repre- 
sented as the objects realizes both the graphical 
user interface (GUI) and the method definition ta- 
ble as a GUI description language, each of said 
plurality of peripheral devices including means for 
sending out the GUI description language to said 



controller. 

9. A control system according to claim 1, wherein 
said controller includes display means for dis- 

5 playing a state of physical connection of each of 

said plurality of peripheral devices represented 
as the objects. 

10. A control system according to claim 1, wherein 
10 said controller includes display means for dis- 
playing a state of operation of each of said plur- 
ality of peripheral devices represented as the ob- 
jects, and varying means for varying the state of 
operation of each of said plurality of peripheral 

15 devices represented as the objects. 

11. A control system according to claim 1, wherein 
said controller includes reading means for read- 
ing, from each of said plurality of peripheral de- 

20 vices represented as the objects, a graphical 

user interface and a method definition table for 
controlling each of said plurality of peripheral de- 
vices, and display means for displaying the 
graphical user interface and the method defini- 

25 tion table. 

12. A control system according to claim 11, wherein 
said controller includes a function for realizing, by 
using a GUI object, processing for reading, from 

30 each of said plurality of peripheral devices repre- 

sented as the objects, the graphical user inter- 
face and the method definition table for control- 
ling each of said plurality of peripheral devices. 

35 13. A control system according to claim 11, wherein 
said controller includes a function for realizing, by 
using a GUI description language, processing for 
reading, from each of said plurality of peripheral 
devices represented as the objects, the graphical 

40 user interface and the method definition table for 

controlling each of said plurality of peripheral de- 
vices. 

14. A control system according to claim 11, wherein 
45 said controller includes means for retrieving from 

the method definition table a method correspond- 
ing to a manipulation of a button or the like of the 
graphical user interface for controlling each of 
said plurality of peripheral devices represented 
so as the objects, and means for sending the re- 

trieved method as a message to a desired one of 
said plurality of peripheral devices represented 
as the objects. 

55 15. A control system according to claim 1, wherein 
said controller includes a function for download- 
ing a program and data from an external periph- 
eral device for the purpose of functionally modi- 
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f ying said controller itself, such as enhancing the 
function thereof or fixing a bug. 

16. A system control apparatus comprising: 

a plurality of peripheral devices represent- 
ed as objects; and 

a controller for unitarily controlling said 
plurality of peripheral devices via a common com- 
munication line, 

said controller and said plurality of periph- 
eral devices each including a bi-directional inter- 
face for bi-directionally communicating data over 
the communication line, 

object data af>out control of a function of 
each of said plurality of peripheral devices being 
stored in a respective one of said plurality of per- 
ipheral devices in advance, 

said controller loading, when connected to 
an arbitrary peripheral device selected from 
among said plurality of peripheral devices, the 
object data from the arbitrary peripheral device to 
form an object corresponding to the arbitrary per- 
ipheral device and also to display under control of 
said controller a manipulation picture for manip- 
ulating the arbitrary peripheral device on the ba- 
sis of the object data, 

said controller outputting an instruction to 
the communication line via the object in accor- 
dance with a manipulation based on the manipu- 
lation picture displayed on said controller, and 30 
controlling the arbitrary peripheral device. 

17. A system control apparatus according to claim 
16, wherein said plurality of peripheral devices 
represented as the objects and said controller 35 
each include message communicating means for 
communicating a message indicative of a control 
instruction, a data input/output instruction or the 
like between each of said plurality of peripheral 
devices and said controller. 40 

18. A system control apparatus according to claim 
16, wherein said plurality of peripheral devices 
represented as the objects and said controller 
each include a group of methods containing exe- 45 
cution procedures, functions, subroutines and 
the like each of which is to be specified by the 
message, as well as an environment for execut- 
ing each of the methods. 

OA 50 

9. A system control apparatus according to claim 
16, wherein said plurality of peripheral devices 
represented as the objects and said controller 
are each encapsulated in such a manner as to 
hide internal data indicative of an internal state, 55 
a variable parameter and the like in its inside and 
also to call a method to indirectly access the in- 
ternal data. 



20. A system control apparatus according to claim 
1 6, wherein each of said plurality of peripheral de- 
vices represented as the objects holds a manip- 
ulation panel, a display device and the like as a 
5 graphical user interface (GUI) in such a manner 

as to be able to be manipulated or provide display 
by means of said controller located externally of 
each of said plurality of peripheral devices, each 
of said plurality of peripheral devices including 
10 means for sending out the graphical user inter- 

face to said controller. 

21. A system control apparatus according to claim 

20, wherein each of said plurality of peripheral de- 
15 vices represented as the objects includes a meth- 
od definition table which defines a method corre- 
sponding to an operation of the manipulation pan- 
el held as the graphical user interface (GUI), and 
means for sending out the method definition table 

20 to said controller. 

22. A system control apparatus according to claim 

21, wherein each of said plurality of peripheral de- 
vices represented as the objects, realizes both 
the graphical user interface (GUI) and the meth- 
od definition table as a GUI object, each of said 
plurality of peripheral devices including means for 
sending out the GUI object to said controller. 

23. A system control apparatus according to claim 
21 , wherein each of said plurality of peripheral de- 
vices represented as the objects realizes both 
the graphical user interface (GUI) and the meth- 
od definition table as a predetermined descrip- 
tion language, each of said plurality of peripheral 
devices including means for sending out the pre- 
determined description language to said control- 
ler. 

24. A system control apparatus according to claim 
16, wherein said controller includes display 
means for displaying a state of physical connec- 
tion of each of said plurality of peripheral devices 
represented as the objects. 

25. A system control apparatus according to claim 
16, wherein said controller includes display 
means for displaying a state of operation of each 
of said plurality of peripheral devices represented 
as the objects, and varying means for varying the 
state of operation of each of said plurality of per- 
ipheral devices represented as the objects. 

26. A control system comprising: 
a plurality of multimedia devices; and 
a control device for controlling said plural- 
ity of multimedia devices, 

said plurality of multimedia devices and 
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said control device being connected to a network 
in such a manner that said plurality of multimedia 
devices and said control device can communi- 
cate a message and data based on an object-ori- 
ented technique between each of said plurality of 5 
multimedia devices and said control device via 
the network, 

said control device including display 
means for displaying icons representative of said 
respective plurality of multimedia devices, and 10 
pointing means for forming a link between arbi- 
trary multimedia devices selected from among 
said plurality of multimedia devices to specify a 
data input and output relationship between the 
arbitrary/multimedia devices. 15 

27. A control system according to claim 26, further 
comprising a user interface for displaying the link 
and the icons representative of said respective 
plurality of multimedia devices connected to the 20 
network, and display means for displaying said 
user interface. 

28. A system control apparatus comprising: 

a plurality of multimedia devices; and 25 

a control device for controlling said plural- 
ity of multimedia devices, 

said plurality of multimedia devices and 
said control device being connected to a network 
in such a manner that said plurality of multimedia 30 
devices and said control device can communi- 
cate a message and data based on an object-ori- 
ented technique between each of said plurality of 
multimedia devices and said control device via 
the network, 35 

said control device for controlling said 
plurality of peripheral devices including data input 
and output relationship specifying means and 
data format acceptability determining means, the 
data format acceptability determining means be- 40 
ing arranged to determine, when a data input and 
output relationship is specified between arbitrary 
multimedia devices selected from among said 
plurality of multimedia devices, whether there is 
a data format acceptable to the selected, arbitra- 45 
ry multimedia devices. 

29. A system control apparatus according to claim 
28, further comprising means for issuing, if the 
data format acceptability determining means de- so 
termines that there is no data format acceptable 

to the selected, arbitrary multimedia devices, a 
message indicating that data communication is 
impossible because there is no data format ac- 
ceptable to the selected, arbitrary multimedia de- 55 
vices. 

30. A multimedia device which constitutes part of a 

35 
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system including a plurality of multimedia devic- 
es and a control device for controlling said plur- 
ality of multimedia devices, the plurality of multi- 
media devices and the control device being con- 
nected to a network in such a manner that the 
plurality of multimedia devices and the control 
device can communicate a message and data 
based on an object-oriented technique between 
each of the plurality of multimedia devices and 
the control device via the network, said multime- 
dia device comprising: 

answer means for answering an inquiry 
about a file format which can be inputted or out- 
putted, the inquiry being transmitted from the 
control device; and 

means for informing, if a plurality of data 
formats can be inputted or outputted, the control 
device of an order of priorities of the plurality of 
data formats. 

31. A system control apparatus for controlling a plur- 
ality of multimedia devices in a system which in- 
cludes the plurality of multimedia devices and a 
control device for controlling the plurality of mul- 
timedia devices, the plurality of multimedia devic- 
es and the control device being connected to a 
network in such a manner that the plurality of 
multimedia devices and the control device can 
communicate a message and data based on an 
object-oriented technique between each of the 
plurality of multimedia devices and the control 
device via the network, said system control appa- 
ratus comprising: 

means for introducing data in which a 
class based on an object-oriented technique is 
described, from an external part; and 

means for generating an object from the 
class based on the object-oriented technique. 

32. A data recording apparatus suitable for use in a 
system in which a plurality of devices can com- 
municate data to each other via a network, com- 
prising: 

storage means for temporarily storing in- 
formation contained in a header part of time- 
series data if the time-series data is transmitted 
in real time when a data recording mode is not ac- 
tive; and 

recording means for reading, if the data re- 
cording mode becomes active, the header part 
from said storage means, locating the header 
part at a leading end of the time-series data and 
recording the header part as well as the time- 
series data on a recording medium. 

33. A control apparatus suitable for use in a system 
in which a plurality of devices can communicate 
data to each other via a network, comprising: 
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decision means for determining whether a 
program data has been received via the network; 
and 

activating means for automatically activat- 
ing a program based on the program data if said 
decision means determines that the program 
data has been received. 

34. A multimedia control system comprising; 

multimedia devices; and j 

a multimedia controller for unitarily man- 
aging said multimedia devices, 

said multimedia devices and said multime- 
dia controller being connected to each other via 
a communication line, 1 

said multimedia devices each including a 
first interface control unit which functions to su- 
pervise communication with said multimedia 
controller, 

the first interface control unit including an 2i 
interface controllerfor controlling communication 
at a physical or logical low level and a first system 
controller for executing communication with a de- 
vice function unit of each of said multimedia de- 
vices and control of the interface control unit, 21 

said multimedia controller including a sec- 
ond interface control unit for controlling commu- 
nication with each of said multimedia devices, 

the second interface control unit including: 
an interface controllerfor controlling com- 30 
munication at a physical or logical low level; 

device connection/disconnection signal 
processing means for processing a device con- 
nection signal indicative of a connection of any of 
said multimedia devices which connection is de- 35 
tected by the interface controller or a device dis- 
connection signal indicative of a disconnection of 
any of said multimedia devices which disconnec- 
tion is detected by the interface controller; 

storage means for storing a device con- 40 
nection management table which is to be referred: 
to and updated in the device connection/discon- 
nection signal processing means; and 

a second system controller for executing 
communication with a controller function unit of 45 
said multimedia controller and the second inter- 
face control unit 

35. A multimedia control system according to claim 

34, wherein said multimedia controller includes a 50 
first timer circuit which starts its operation in syn- 
chronism with a power-on operation of said mul- 
timedia controller, connection confirmation mes- 
sage sending means for sending a connection 
confirmation message to each of said multimedia 55 
devices at regular intervals in accordance with an 
output of the first timer circuit, and means for up- 
dating the device connection management table 



on the basis of state information about said mul- 
timedia devices which is obtained from the de- 
vice connection signal transmitted by each of 
said multimedia devices in response to the con- 
nection confirmation message signal. 

36. A multimedia control system according to claim 
35, wherein said multimedia controller further in- 
cludes message re-sending means for re-send- 
ing the connection confirmation message to a 
multimedia device which, while said multimedia 
control system is confirming a connection status 
about said multimedia control system through the 
connection confirmation message sending 
means, does not retransmit any of the device 
connection signals corresponding to individual 
multimedia devices registered on the device con- 
nection management table, and means for eras- 
ing an area corresponding to the multimedia de- 
vice from the device connection management ta- 
ble if no acknowledgment of the connection con- 
firmation message re-sent from the message re- 
sending means is retransmitted from the multi- 
media device. 

37. A multimedia control system according to claim 
34, wherein each of said multimedia devices in- 
cludes a second timer circuit which starts its op- 
eration in synchronism with a power-on operation 
of a respective one of said multimedia devices, 
and means for sending the device connection sig- 
nal to said multimedia controller at regular inter- 
vals in accordance with an output of the second 
timer circuit, said multimedia controller includes 
means for updating the device connection man- 
agement table on the basis of state information 
about said multimedia devices which is obtained 
from the device connection signal. 

38. A multimedia control system according to claim 
37, wherein said multimedia controller includes: 
means arranged to set, on the device con- 
nection management table, counters corre- 
sponding to said respective multimedia devices 
on a one-to-one basis if said multimedia control- 
ler, while confirming a connection status about 
said multimedia control system on the basis of 
the device connection signals retransmitted from 
said respective multimedia devices, determines 
that a particular one of the device connection sig- 
nals retransmitted from said respective multime- 
dia devices to said multimedia controller is a sig- 
nal retransmitted from a multimedia device which 
is not yet registered on the device connection 
management table, and 

arranged to reset the counters which are 
already set on the device connection manage- 
ment table and correspond to said respective 
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multimedia devices on a one-to-one basis, if said 
multimedia controller, while confirming the con- 
nection status about said multimedia control sys- 
tem on the basis of the device connection signals 
retransmitted from said respective multimedia 
devices, determines that the particular device 
connection signal is a signal retransmitted from 
a multimedia device which is already registered 
on the device connection management table; 

means for independently incrementing the 
respective counters in synchronism with the out- 
put of the first timer circuit; 

message re-sending means for re-sending 
the connection confirmation message at least 
once from said multimedia controller to each of 
said multimedia devices if the value of a respec- 
tive one of the counters exceeds a predetermined 
threshold; and 

means for erasing an area corresponding 
to a particular multimedia device from the device 
connection management table if no acknowledg- 
ment of the connection confirmation message re- 
sent from the message re-sending means is re- 
transmitted from the particular multimedia de- 
vice. 

39. A multimedia control system according to claim 
34, wherein each of said multimedia devices in- 
cludes at least two network line connection ter- 
minals, line connection detecting circuits corre- 
sponding to the respective network line connec- 
tion terminals on a one-to-one basis, and means 
for transmitting the device connection signal or 
the device disconnection signal to said multime- 
dia controller if the means detects a variation in 
a state of connection or disconnection of an arbi- 
trary one of said multimedia devices which vari- 
ation is an output from the arbitrary one, 

if a second multimedia device is connect- 
ed to a first multimedia device from among said 
multimedia devices, the first multimedia device 
transmitting the device connection signal to said 
multimedia controller in accordance with an out- 
put of the line connection detecting circuit of the 
first multimedia device which corresponds to the 
network line connection terminal to which the 
second multimedia device is connected, 

if the second multimedia device is discon- 
nected from the first multimedia device, the first 
multimedia device transmitting the device dis- 
connection signal to said multimedia controller in 
accordance with an output of the line connection 
detecting circuit of the first multimedia device 
which corresponds to the network line connec- 
tion terminal from which the second multimedia 
device is disconnected, 

said multimedia controller including 
means for receiving the device connection signal 



or the device disconnection signal and updating 
the device connection management table in the 
device connection/disconnection signal process- 
ing means. 

5 

40. A multimedia control system according to claim 
39, wherein said multimedia controller includes 
message re-sending means for re-sending, when 
said multimedia controller receives the device 

io disconnection signal, the connection confirma- 

tion message to a multimedia device which has 
transmitted the device disconnection signal, and 
means for erasing an area corresponding to the 
multimedia device from the device connection 

is management table if no acknowledgment of the 

connection confirmation message re-sent from 
the message re-sending means is retransmitted 
from the multimedia device. 

20 41. A multimedia control system according to claim 
34, wherein a relay is provided between said mul- 
timedia controller and each of said multimedia 
devices, said relay including network line con- 
nection terminals for connection to said respec- 

25 tive multimedia devices, line connection detect- 

ing circuits corresponding to the respective net- 
work line connection terminals on a one-to-one 
basis, means for transmitting the device connec- 
tion signal or the device disconnection signal to 

30 said multimedia controller in accordance with an 

output of any of said line connection detecting cir- 
cuits, an interface controller for controlling com- 
munication ata physical or logical low level, and 
control means for controlling all constituent ele- 

35 ments of the relay, said multimedia controller in- 

cluding means for receiving the device discon- 
nection signal or the device connection signal 
and updating the device connection manage- 
ment table. 

40 

42. A multimedia control system according to claim 
41, wherein said means for receiving the device 
disconnection signal or the device connection 
signal and updating the device connection man- 

45 agement table in said multimedia controller in- 

cludes message re-sending means for re-send- 
ing the connection confirmation message to a 
multimedia device which has transmitted the de- 
vice disconnection signal or the device connec- 

so tion signal, and means for erasing an area corre- 

sponding to the multimedia device from the de- 
vice connection management table if no acknowl- 
edgment of the connection confirmation mes- 
sage re-sent from the message re-sending 

55 means is retransmitted from the multimedia de- 

vice. 

43. A multimedia control system according to claim 
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35 or 36 t wherein each of said multimedia devic- 
es includes network line connection terminals, 
line connection detecting circuits corresponding 
to the respective network line connection termi- 
nals, and means for transmitting the device con- 5 
nection signal or the device disconnection signal 
to said multimedia controller when detecting a 
variation in a state of connection ordisconnection 
of an arbitrary one of said multimedia devices 
which variation is an output from each of said line 10 
connection detecting circuits, said multimedia 
controller including means for receiving the de- 
vice connection signal or the device disconnec- 
tion signal and updating the device connection 
management table in said device connection/dis- 15 
connection signal processing means. 

44. A multimedia control system according to claim 
43, wherein said multimedia devices, said multi- 
media controller and said relay respectively in- 20 
elude line connection connector parts each hav- 
ing a switch to be turned on when a line cable is 
inserted thereinto, a mechanism for locking the 
line cable, and a manipulating member arranged 
to be capable of simultaneously releasing the 25 
locked line cable and turning off the switch, each 
of the line connection connector parts being ar- 
ranged to transmit an output signal of the switch 
to a respective one of said line connection detect- 
ing circuits. 30 

45. A multimedia control system according to claim 
44, wherein said multimedia devices and said 
multimedia controller each include a first power 
source circuit for supplying electrical power to .35 
both of the first and second interface control 
units, and a second power source circuit for exe- 
cuting a power-on/off operation in accordance 
with a manipulation by a user of a main switch of 
a corresponding one of said multimedia devices 40 
and said multimedia controller or in accordance 
with a message sent from said multimedia con- 
troller. 



vice for displaying a respective one of the in- 
formed identification names. 

47. A system for the control of a plurality of peripheral 
apparatuses, in a system including a common 
control means and object-oriented interface 
means whereby each peripheral apparatus can 
be addressed as an object. 

48. A system according to claim 47 wherein said per- 
ipheral apparatuses form a multimedia informa- 
tion storage, processing and/or retrieval system. 

49. A system according to claim 47 or 48, wherein the 
control means includes means for receiving from 
a newly added peripheral apparatus a pre-stored 
software definition of the corresponding object, 
for storage in a memory area of the control 
means. 

50. A system according to any of claims 47 to 50, 
wherein the control means communicates with all 
peripheral apparatuses via a common communi- 
cation line. 



>. A multimedia control system according to claim 45 
45, wherein said multimedia controller includes 
means for assigning said respective multimedia 
devices unique identification names correspond- 
ing to said respective multimedia devices on a 
one-to-one basis at a time when said multimedia so 
controller recognizes said multimedia devices 
connected to said multimedia control system by 
receiving the device connection signal or the de- 
vice disconnection signal and updating the de- 
vice connection management table, and means 55 
for informing the assigned identification names 
of the respective multimedia devices, each of 
said multimedia devices including a display de- 
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